-- Logs begin at Fri 2022-06-24 07:52:48 UTC, end at Fri 2022-06-24 09:01:49 UTC. -- Jun 24 08:31:56.710189 dv-cinder-847131-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 08:31:56.718527 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 08:31:56.720583 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:31:56 2022] *** Jun 24 08:31:56.720583 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:31:56.720583 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:31:56.720583 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: nodename: dv-cinder-847131-2-iscsi Jun 24 08:31:56.720583 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: machine: x86_64 Jun 24 08:31:56.720583 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: clock source: unix Jun 24 08:31:56.720583 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: pcre jit disabled Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: detected number of CPU cores: 4 Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: current working directory: / Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: your processes number limit is 47680 Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: your memory page size is 4096 bytes Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: detected max file descriptor number: 2048 Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: lock engine: pthread robust mutexes Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: thunder lock: enabled Jun 24 08:31:56.721084 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 08:31:56.721657 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:31:56.767394 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: Python main interpreter initialized at 0x560a9b0089c0 Jun 24 08:31:56.767394 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: python threads support enabled Jun 24 08:31:56.767394 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: your server socket listen backlog is limited to 100 connections Jun 24 08:31:56.767394 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:31:56.767811 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:31:56.767888 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: *** Operational MODE: preforking *** Jun 24 08:31:56.768124 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:31:56.768124 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: spawned uWSGI master process (pid: 109887) Jun 24 08:31:56.768350 dv-cinder-847131-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 08:31:56.776898 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: spawned uWSGI worker 1 (pid: 109888, cores: 1) Jun 24 08:31:56.776898 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: spawned uWSGI worker 2 (pid: 109889, cores: 1) Jun 24 08:31:56.776898 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:31:57.437124 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:31:57.446010 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:31:58.563841 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:31:58.563841 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: from cryptography.utils import int_from_bytes Jun 24 08:31:58.564523 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:31:58.564523 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: from cryptography.utils import int_from_bytes Jun 24 08:31:58.564659 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:31:58.564659 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: from cryptography.utils import int_from_bytes Jun 24 08:31:58.565026 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:31:58.565026 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: from cryptography.utils import int_from_bytes Jun 24 08:32:01.082754 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:32:01.083414 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:32:01.083544 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:32:01.083906 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:32:01.084162 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:32:01.084544 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.084869 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.085191 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.085509 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.085874 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.086186 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.086505 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.086821 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.087146 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.087405 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.087716 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.088038 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-2-iscsi {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.088357 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.088662 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.089034 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.089353 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.089444 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:32:01.089824 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:32:01.089919 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.090098 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.090411 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.090495 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:32:01.090783 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:32:01.090905 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.091052 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:32:01.091348 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.091454 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.091656 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.091765 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.091968 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.092115 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.092303 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.092400 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.092616 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.092709 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.092923 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.093025 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.093241 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.093333 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.093548 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.093648 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.093900 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.094009 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.094211 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.094306 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.094566 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.094659 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-2-iscsi {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.094896 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-2-iscsi {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.094989 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.095214 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.095303 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.095526 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.095617 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.095841 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.095925 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.096164 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.096248 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.096479 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.096571 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.096804 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.096901 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.097116 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.097200 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.097440 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.097627 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.097794 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.097973 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.098114 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.098286 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.098433 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.098602 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.098753 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.098944 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.099053 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.099265 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.099354 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.099582 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.099668 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.099908 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.099993 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.100222 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.100313 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.100547 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.100638 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.100796 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.100888 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.101105 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.101248 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-2-iscsi {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.101423 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.101573 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.101765 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.101917 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.102087 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.102240 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.102327 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.102575 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.102661 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.102893 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.102991 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.103212 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.103297 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.103521 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.103605 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.103829 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.103927 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.104136 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.104228 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.104968 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.105066 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.105352 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.105445 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.105681 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.105811 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.106029 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.106124 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.106340 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.106425 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.106656 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.106740 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.106972 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.107057 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.107298 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.107383 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.107608 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.107693 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.107922 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.108005 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.108178 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.108335 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.108491 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.108575 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.108822 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.108907 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.109149 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.109234 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.109476 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.109561 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.109758 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.109860 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.110009 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.110138 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.110334 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.110459 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.110660 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.110762 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.110976 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.111061 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.111293 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.111377 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.111613 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.111705 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.111926 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.112010 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.112240 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.112332 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.112506 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.112596 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.112808 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.112891 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.113113 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.113197 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.113428 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.113512 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.113753 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.113839 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.114062 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.114157 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.114369 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.114462 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.114666 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.114750 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.114972 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.115110 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.115275 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.115360 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.115579 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.115667 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.115883 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.116001 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.116189 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.116328 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.116491 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.116644 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.116796 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.116969 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.117099 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.117296 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.117388 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.117610 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.117724 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.117946 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.118066 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.118262 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.118354 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.118588 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.118672 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.118897 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.118982 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.119202 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.119288 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.119469 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.119551 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.119774 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.119858 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.120682 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.120777 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.121072 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.121313 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.121412 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.121491 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.121677 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.121817 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.122018 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.122116 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.122327 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.122417 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.122632 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.122716 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.122944 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.123036 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.123243 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.123326 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.123552 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.123636 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.123864 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.123954 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.124170 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.124317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.124477 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.124562 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.124779 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.124874 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.125082 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.125173 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.125384 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.125476 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.125708 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.125799 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.126009 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.126094 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.126312 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.126396 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.126611 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.126696 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.126924 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.127017 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.127244 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.127328 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.127553 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.127639 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.127860 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.127944 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.128163 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.128254 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.128478 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.128563 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.128791 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.128874 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.129119 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.129204 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.129436 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.129528 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.129776 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.129865 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.130109 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.130193 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.130421 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.130507 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.130736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.130826 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.131048 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.131148 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.131364 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.131448 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.131675 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.131758 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.131986 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.132078 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.132294 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.132378 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.132604 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.132693 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.132915 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.133011 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.133224 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.133308 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.133535 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.133618 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.133867 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.133967 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.134181 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.134272 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.134501 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.134584 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.134812 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.134897 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.135122 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.135242 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.135433 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.135525 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.136144 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:32:01.136344 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.136460 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.136543 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.136804 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.136888 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.137151 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.137244 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.137468 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.137561 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.137818 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.137944 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.138144 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.138264 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.138457 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.138614 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.138768 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.138853 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.139079 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.139171 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.139406 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.139491 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.139739 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.139823 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.140052 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.140138 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.140369 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.140463 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.140683 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.140774 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.140998 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.141081 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.141309 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.141392 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.141622 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.141786 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.141962 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.142053 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.142293 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.142377 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.142607 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.142700 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.142922 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.143014 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.143236 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.143331 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.143552 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.143646 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.143866 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.143951 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.144195 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.144287 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.144490 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.144580 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.144793 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.144881 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.145097 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.145188 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.145403 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.145487 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.145741 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.145871 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.146035 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.146132 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.146352 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.146438 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.146675 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.146761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.146980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.147063 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.147312 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.147398 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.147618 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.147702 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.147928 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.148071 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.148237 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.148368 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.148544 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.148629 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.148847 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.148940 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.149165 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.149256 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.149477 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.149563 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.149811 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.149909 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.150135 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.150219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.150447 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.150531 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.150754 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.150847 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.151078 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.151165 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.151408 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.151547 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.151716 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.151920 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.152105 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.152188 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.152330 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.152498 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.152642 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.152812 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.152956 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.153129 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.153266 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.153443 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.153589 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.153800 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.153931 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.154133 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.154245 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.154448 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.154578 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.154789 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.154909 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.155106 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.155213 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.155424 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.155537 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.155743 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.155865 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.156064 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.156182 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.156378 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.156485 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.156699 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.156791 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.157016 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.157108 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.157328 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.157413 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.157659 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.157759 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.157991 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.158074 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.158294 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.158387 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.158597 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.158694 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.158898 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.158983 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.159203 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.159289 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.159503 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.159588 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.159822 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.159914 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.160128 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.160213 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.160433 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.160524 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.160736 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.160835 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.161038 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.161122 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.161378 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.161462 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.161680 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.161807 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.162041 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.162127 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.162375 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.162467 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.162688 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.162772 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.163007 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.163091 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.163320 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.163412 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.163636 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.163721 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.163946 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.164032 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.164257 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.164341 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.164567 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.164652 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.164877 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.164972 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.165188 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.165275 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.165499 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.165585 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.165843 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.165931 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.166155 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.166245 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.166462 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.166558 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.166776 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.167390 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.167618 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.167813 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.167951 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.168167 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.168304 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.168435 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.168567 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.168777 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.168870 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.169117 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.169200 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.169437 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.169527 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.169783 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.169872 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.170100 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.170209 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.170415 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.170500 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.170723 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.170817 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.171034 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.171145 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.171344 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.171468 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.171655 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.171794 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.171974 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.172112 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.172286 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.172431 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.172605 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.172750 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.172914 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.173067 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.173235 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.173394 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.173547 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.173730 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.173894 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.174061 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.174200 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.174379 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.174514 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.174709 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.174842 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.175026 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.175172 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.175354 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.175481 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.175666 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.175794 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.175989 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.176116 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.176428 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.176511 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.176736 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.176820 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.177054 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.177181 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.177360 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.177450 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.177664 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.177802 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.177997 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.178096 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.178311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.178425 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.178619 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.178749 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.178932 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.179026 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.179236 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.179320 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.179551 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.179636 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.179858 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.179943 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.180162 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.180246 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.180464 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.180548 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.180776 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.180860 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.181096 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.181179 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.181407 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.181498 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.181744 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.181832 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.182067 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.182151 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.182371 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.182505 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.182722 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.182882 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.183038 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.183125 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.183347 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.183446 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.183655 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.183749 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.183959 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.184044 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.184262 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.184359 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.184606 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.184690 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.184920 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.185040 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.185225 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.185358 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.185540 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.185731 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.185887 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.186198 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.186289 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.186514 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.186829 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.186915 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.187136 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.187394 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.187491 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.187754 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.187838 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.188064 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.188208 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.188377 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.188689 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.188807 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.189008 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.189320 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.189403 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.189643 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.189890 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.189978 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.190277 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.190474 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.190589 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.190833 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.190926 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.191177 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.191263 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.191496 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.191587 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.191900 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.192071 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.192407 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.192499 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.192726 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.193028 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.193121 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.193355 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.193566 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.193677 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.193928 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.194014 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.194257 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.194343 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.194581 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.194666 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.194904 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.195062 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.195264 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.195357 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.195571 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.195653 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.195877 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.195969 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.196191 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.196288 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.196498 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.196583 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.196806 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.196889 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.197111 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.197203 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.197420 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.197511 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.197743 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.197841 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.198051 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.198240 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.198481 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.198605 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.198789 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.198878 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.199112 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.199198 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.199415 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.199501 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.199730 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.199821 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.200048 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.200134 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.200372 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.200463 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.200684 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.200814 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.200991 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.201155 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.201291 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.201480 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.201597 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.201892 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.202036 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.202222 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.202342 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.202678 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.202769 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.203004 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.203344 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.203650 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.203733 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.203953 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.204252 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.204350 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.204566 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.204830 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.204914 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.205157 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.205240 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.205464 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.205550 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.205797 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.205899 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.206099 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.206248 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.206410 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.206720 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.206868 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.207028 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.207334 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.207426 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.207635 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.207729 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.207942 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.208061 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.208242 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.208384 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.208554 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.208708 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.208861 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.209093 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.209199 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.209349 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.209443 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.209667 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.209796 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.210014 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.210099 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.210336 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.210434 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.210649 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.210741 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.210953 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.211037 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.211266 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.211352 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.211568 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.211652 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.211869 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.211954 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.212170 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.212256 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.212475 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.212559 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.212780 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.212864 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.213082 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.213167 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.213401 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.213486 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.214244 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.214342 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.214569 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.214656 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.214942 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.215035 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.215255 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.215359 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.215560 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.215657 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.215862 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.215953 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.216170 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.216264 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.216491 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.216628 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.216808 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.216893 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.217111 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.217205 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.217418 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.217533 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.217740 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.217882 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.218051 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.218201 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.218351 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.218513 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.218658 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.218831 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.218960 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.219154 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.219267 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.219466 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.219559 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.219786 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.219889 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.220106 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.220197 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.220426 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.220516 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.220734 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.220831 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.221038 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.221128 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.221341 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.221436 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.221643 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.221770 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.221992 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.222081 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.222299 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.222387 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.222615 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.222715 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.222928 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.223014 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.223241 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.223333 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.223555 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.223640 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.223864 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.223947 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.224175 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.224261 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.224485 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.224570 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.224786 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.224869 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.225097 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.225181 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.225408 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.225494 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.225738 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.225836 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.226041 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.226164 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.226342 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.226428 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.226658 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.226748 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.226969 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.227065 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.227280 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.227371 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.227596 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.227679 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.227909 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.228002 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.228226 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.228311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.228524 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.228607 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.228832 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.228967 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.229142 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.229244 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.230027 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.230185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.230359 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.230506 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.230790 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.230876 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.231111 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.231202 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.231423 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.231508 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.231737 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.231821 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.232050 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.232141 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.232360 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.232445 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.232666 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.232758 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.232974 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.233059 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.233282 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.233374 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.233585 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.233670 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.233934 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.234019 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.234243 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.234329 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.234544 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.234628 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.234849 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.234943 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.235151 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.235242 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.235460 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.235548 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.235763 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.235902 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.236193 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.236323 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.236505 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.236590 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.236815 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.236909 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.237118 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.237202 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.237428 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.237519 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.237766 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.237866 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.238082 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.238167 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.238393 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.238477 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.238694 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.238780 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.239047 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.239138 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.239368 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.239501 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.239689 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.239782 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.240004 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.240088 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.240307 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.240391 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.240607 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.240692 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.240917 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.241003 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.241237 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.241322 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.241539 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.241624 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.241864 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.241950 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.242166 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.242266 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.242483 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.242570 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.242784 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.242874 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.243101 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.243230 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.243436 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.243522 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.243755 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.243848 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.244071 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.244163 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.244394 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.244498 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.244703 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.244832 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.245641 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.245781 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.245989 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.246075 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.246311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.246443 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.246633 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.246760 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.246938 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.247077 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.247251 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.247395 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.247561 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.247709 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.247884 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.248043 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.248205 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.248362 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.248518 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.248675 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.248831 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.248989 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.249122 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.249654 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.249796 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.249879 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.249977 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.250087 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.250296 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.250393 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.250741 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.250827 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.251067 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.251155 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.251390 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.251492 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.251711 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.251795 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.252032 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.252123 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.252338 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.252430 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.252640 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.252724 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.252947 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.253040 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.253253 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.253413 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.253556 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.253681 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.253903 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.254031 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.254205 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.254353 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.254516 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.254672 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.254827 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.254988 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.255135 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.255300 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.255436 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.255619 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.255738 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.255950 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.256057 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.256262 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.256354 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.256576 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.256665 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.256888 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.257008 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.257218 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.257312 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.257531 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.257616 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.257883 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.257971 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.258205 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.258303 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.258512 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.258598 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.258817 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.258903 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.259119 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.259324 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.259413 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.259643 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.259734 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.259961 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.260058 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.260290 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.260374 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.261193 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.261440 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.261526 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.261666 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.261870 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.262049 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.262186 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.262327 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.262512 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.262651 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.262831 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.262990 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.263149 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.263329 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.263474 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.263653 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.263778 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.263978 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.264103 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.264295 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.264459 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.264630 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.264716 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.264960 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.265043 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.265264 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.265357 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.265572 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.265665 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.265899 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.266040 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.266203 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.266374 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.266504 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.266693 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.266826 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.267025 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.267131 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.267359 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.267448 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.267674 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.267758 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.267989 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.268082 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.268309 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.268395 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.268617 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.268701 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.268928 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.269019 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.269248 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.269332 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.269562 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.269646 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.269905 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.270011 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.270224 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.270315 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.270541 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.270624 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.270848 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.270932 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.271157 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.271240 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.271473 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.271556 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.271788 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.271874 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.272105 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.272192 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.272419 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.272504 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.272734 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.272819 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.273048 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.273133 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.273361 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.273444 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.273668 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.273794 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.274005 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.274091 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.274315 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.274407 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.274627 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.274718 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.274937 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.275177 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.275285 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.275511 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.275596 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.275827 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.275920 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.276140 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.276254 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.276471 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.276582 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.276787 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.276915 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.277135 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.277313 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.277408 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.277654 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.277761 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.278004 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.278098 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.278326 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.278411 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.278653 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.278740 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.278966 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.279050 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.279282 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.279368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.279598 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.279683 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.279910 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.280003 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.280222 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.280306 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.280533 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.280617 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.280845 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.280937 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.281153 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.281238 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.281465 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.281550 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.281805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.281905 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.282127 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.282211 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.282438 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.282523 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.282748 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.282832 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.283060 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.283144 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.283369 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.283454 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.283680 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.283766 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.283989 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.284082 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.284297 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.284382 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.284603 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.284689 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.284914 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.284999 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.285225 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.285310 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.285545 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.285637 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.285899 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.285987 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.286217 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.286311 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.286527 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.286611 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.286837 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.286921 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.287151 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.287248 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.287504 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.287668 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.287829 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.287979 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.288153 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.288312 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.288479 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.288636 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.288804 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.288959 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.289122 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.289275 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.289444 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.289593 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.289790 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.289942 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.290116 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.290248 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.290551 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.290667 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.290860 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.291003 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.291167 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.291326 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.291468 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.291650 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.291788 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.291993 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.292114 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.292316 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.292403 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.292636 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.292820 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.292948 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.293262 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.293363 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.293562 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.293654 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.293903 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.294067 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.294238 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.294323 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.294569 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.294657 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.294903 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.294997 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.295243 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.295326 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.295549 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.295635 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.295872 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.295966 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.296178 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.296262 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.296482 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.296574 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.296798 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.296884 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.297107 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.297192 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.297411 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.297496 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.297732 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.297822 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.298046 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.298143 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.298354 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.298446 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.298656 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.298742 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.298962 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.299053 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.299265 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.299362 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.299601 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.299685 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.299905 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.299988 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.300207 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.300303 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.300508 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.300593 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.300822 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.300908 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.301126 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.301220 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.301428 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.301513 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.301751 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.301851 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.302055 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.302142 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.302364 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.302448 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.302664 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.302756 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.302970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.303268 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.303351 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.303577 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.303661 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.303876 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.303971 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.304183 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.304268 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.304531 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.304615 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.304854 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.304947 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.305158 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.305244 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.305458 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.305543 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.305793 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.305882 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.306107 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.306192 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.306427 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.306511 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.306737 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.306824 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.307049 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.307135 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.307377 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.308007 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.308221 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.308308 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.308535 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.308818 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.309049 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.309157 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.309371 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.309490 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.309850 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.309937 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.310186 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.310284 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.310496 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.310580 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.310803 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.310919 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.311109 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.311256 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.311431 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.311583 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.311742 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.311900 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.312051 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.312238 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.312358 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.312553 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.312666 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.312866 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.312960 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.313192 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.313277 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.313513 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.313597 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.313850 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.313950 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.314165 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.314250 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.314479 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.314564 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.314787 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.314880 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.315094 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.315186 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.315400 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.315493 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.315708 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.315801 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.316043 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.316134 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.316353 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.316444 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.316666 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.316752 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.316977 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.317062 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.317292 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.317375 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.317603 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.317730 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.317936 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.318019 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.318245 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.318329 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.318553 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.318646 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.318867 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.318950 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.319175 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.319266 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.319492 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.319577 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.319794 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.319883 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.320109 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.320201 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.320421 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.320506 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.320736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.320821 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.321090 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.321183 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.321407 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.321491 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.321736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.321834 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.322051 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.322144 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.322362 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.322447 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.322681 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.322765 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.322988 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.323110 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.323372 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.323612 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.323699 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.323941 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.324102 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.324298 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.324383 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.324604 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.324698 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.324907 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.325146 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.325233 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.325490 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.325577 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.325830 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.325931 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.326141 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.326227 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.326443 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.326527 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.326745 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.326842 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.327053 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.327140 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.327356 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.327449 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.327659 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.327752 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.327960 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.328052 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.328263 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.328355 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.328570 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.328667 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.328872 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.328959 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.329175 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.329262 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.329483 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.329569 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.329810 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.329897 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.330113 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.330197 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.330416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.330503 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.330722 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.330821 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.331026 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.331110 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.331329 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.331414 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.331632 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.331717 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.331934 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.332020 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.332235 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.332322 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.332567 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.332693 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.332945 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.333047 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.333234 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.333395 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.333537 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.333624 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.333877 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.333980 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.334197 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.334289 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.334506 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.334591 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.334821 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.334917 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.335139 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.335223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.335453 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.335546 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.335762 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.335848 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.336079 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.336163 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.336388 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.336507 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.336701 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.336826 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.337013 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.337152 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.337323 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.337479 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.337631 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.337822 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.337967 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.338151 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.338291 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.338482 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.338616 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.339385 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.339480 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.339739 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.339832 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.340055 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.340206 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.340374 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.340553 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.340690 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.340905 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.340999 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.341246 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.341331 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.341582 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.341667 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.341927 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.342026 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.342242 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.342397 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.342554 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.342718 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.342856 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.343038 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.343166 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.343366 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.343480 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.343684 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.343808 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.343997 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.344133 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.344310 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.344486 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.344629 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.344768 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.344940 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.345092 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.345250 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.345437 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.345560 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.345777 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.345901 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.346124 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.346208 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.346453 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.346555 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.346768 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.346854 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.347082 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.347175 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.347388 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.347483 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.347632 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:32:01.347717 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.348004 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.348319 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.348630 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.348943 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.349264 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.349561 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.349903 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.350246 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.350587 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.350964 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.351245 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.351565 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.351898 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.352217 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.352554 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.352884 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.353209 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.353556 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.353888 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.354208 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.354633 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.355102 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.355424 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.355745 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.356066 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.356404 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.356737 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.357054 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.357390 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.357737 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.358073 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.358396 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.358715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.359053 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.359372 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.359689 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.360011 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.360330 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.360649 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.360974 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.361298 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.361634 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.361994 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.362312 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.362691 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.363033 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.363391 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.363715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.364069 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.364407 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.364733 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.365056 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.365373 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:32:01.365622 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:32:01.428945 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO dbcounter [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Registered counter for database nova_api Jun 24 08:32:01.502607 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO dbcounter [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Registered counter for database nova_api Jun 24 08:32:01.525332 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG oslo_db.sqlalchemy.engines [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:32:01.532995 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writer thread running {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:32:01.539544 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_db.sqlalchemy.engines [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:32:01.546114 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writer thread running {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:32:01.590843 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.context [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9a90baf-9f7e-4d3b-8468-40fa6b0dc594(cell1) {{(pid=109889) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:32:01.594704 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG oslo_concurrency.lockutils [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:01.596314 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG oslo_concurrency.lockutils [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:01.597100 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG oslo_concurrency.lockutils [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:01.599086 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG oslo_concurrency.lockutils [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:01.601047 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO dbcounter [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Registered counter for database nova_cell0 Jun 24 08:32:01.602796 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.context [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9a90baf-9f7e-4d3b-8468-40fa6b0dc594(cell1) {{(pid=109888) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:32:01.605630 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO dbcounter [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Registered counter for database nova_cell1 Jun 24 08:32:01.607283 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:01.608916 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:01.609736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:32:01.611870 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:32:01.613875 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG oslo_db.sqlalchemy.engines [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:32:01.614019 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO dbcounter [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Registered counter for database nova_cell0 Jun 24 08:32:01.615255 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG oslo_db.sqlalchemy.engines [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:32:01.617857 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO dbcounter [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Registered counter for database nova_cell1 Jun 24 08:32:01.621736 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writer thread running {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:32:01.623933 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writer thread running {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:32:01.625255 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_db.sqlalchemy.engines [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:32:01.629989 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writer thread running {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:32:01.630621 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_db.sqlalchemy.engines [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:32:01.770266 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO dbcounter [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Registered counter for database nova_cell0 Jun 24 08:32:01.775094 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writer thread running {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:32:01.779032 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG oslo_db.sqlalchemy.engines [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:32:01.783266 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writer thread running {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:32:01.784435 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO dbcounter [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Registered counter for database nova_cell0 Jun 24 08:32:01.793608 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_db.sqlalchemy.engines [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:32:01.798258 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writer thread running {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:32:02.128871 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: WARNING keystonemiddleware.auth_token [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:32:02.132718 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: WARNING keystonemiddleware.auth_token [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:32:02.136827 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: WARNING keystonemiddleware.auth_token [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:32:02.140649 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: WARNING keystonemiddleware.auth_token [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:32:02.483937 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: WARNING keystonemiddleware.auth_token [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:32:02.484182 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: WARNING keystonemiddleware.auth_token [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:32:02.489914 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: WARNING keystonemiddleware.auth_token [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:32:02.490022 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: WARNING keystonemiddleware.auth_token [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:32:02.495259 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a9b0089c0 pid: 109889 (default app) Jun 24 08:32:02.495398 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a9b0089c0 pid: 109888 (default app) Jun 24 08:32:02.497307 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:32:02.498518 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-953bceb0-d7c8-4533-b812-f662b3844336 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001767 Jun 24 08:32:02.498928 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Fri Jun 24 08:32:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:19.212627 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:19.213860 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 Jun 24 08:33:19.214778 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:19.227625 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writing DB stats nova_api:SELECT=3 {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:19.228621 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writing DB stats nova_cell0:SELECT=3 {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:19.229634 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writing DB stats nova_cell1:SELECT=3 {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:19.231209 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:19.687505 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-2d088c31-3e86-4f15-9b74-6fa4a9fc7c68 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:19.717659 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-2d088c31-3e86-4f15-9b74-6fa4a9fc7c68 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.495132 Jun 24 08:33:19.718534 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1291 bytes} [Fri Jun 24 08:33:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:21.837684 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:21.838716 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-6b191100-fad7-4207-b1f6-1436db78fe15 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 24 08:33:21.842151 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:33:21.904737 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-868708ac-4a26-43d3-855f-6d66dfaec56f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "id": "c1"}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:21.924154 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:33:21.924154 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: warnings.warn(msg) Jun 24 08:33:21.967956 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-868708ac-4a26-43d3-855f-6d66dfaec56f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.121470 Jun 24 08:33:21.968892 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:33:22.245023 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-e1a306d5-c74a-4bbd-8db1-9b58dd6d62ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:22.247989 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:33:22.247989 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: warnings.warn(msg) Jun 24 08:33:22.267234 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_api:SELECT=3 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:22.268188 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_cell0:SELECT=3 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:22.269181 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_cell1:SELECT=3 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:22.270176 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:22.317746 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-e1a306d5-c74a-4bbd-8db1-9b58dd6d62ae admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.335874 Jun 24 08:33:22.321855 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1335 bytes} [Fri Jun 24 08:33:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:24.561253 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-868708ac-4a26-43d3-855f-6d66dfaec56f admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:24.562392 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-868708ac-4a26-43d3-855f-6d66dfaec56f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Jun 24 08:33:24.562913 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:24.672646 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-c66dd767-131b-4fd3-8114-6e2ddd9a6a4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "swap": 0}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:24.691311 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:33:24.691311 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: warnings.warn(msg) Jun 24 08:33:24.709808 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-c66dd767-131b-4fd3-8114-6e2ddd9a6a4f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140834 Jun 24 08:33:24.710373 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:33:24.723447 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-13a8f3b6-be70-418e-9d66-2a12558bfe51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:24.725238 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:33:24.725238 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: warnings.warn(msg) Jun 24 08:33:24.757897 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-13a8f3b6-be70-418e-9d66-2a12558bfe51 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038007 Jun 24 08:33:24.758763 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1335 bytes} [Fri Jun 24 08:33:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:26.911145 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-c66dd767-131b-4fd3-8114-6e2ddd9a6a4f admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:26.912149 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-c66dd767-131b-4fd3-8114-6e2ddd9a6a4f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 24 08:33:26.912543 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:26.976984 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-e49f4526-63e3-4e67-8676-c559559c9b76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:26.996242 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-e49f4526-63e3-4e67-8676-c559559c9b76 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077306 Jun 24 08:33:26.997032 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:33:27.009166 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-94a35770-a710-416f-bd72-513d294a9c03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:27.033923 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-94a35770-a710-416f-bd72-513d294a9c03 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028415 Jun 24 08:33:27.034748 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1335 bytes} [Fri Jun 24 08:33:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:29.147551 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-e49f4526-63e3-4e67-8676-c559559c9b76 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:29.148650 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-e49f4526-63e3-4e67-8676-c559559c9b76 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jun 24 08:33:29.149127 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:29.208662 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-d7580f86-dd92-4610-8398-17b073e0ba19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "id": "d3", "swap": 0, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:29.226811 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-d7580f86-dd92-4610-8398-17b073e0ba19 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071268 Jun 24 08:33:29.227392 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:33:29.239807 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-d936eae4-9486-4164-88df-0050e471d64e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:29.262363 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-d936eae4-9486-4164-88df-0050e471d64e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026192 Jun 24 08:33:29.263133 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1335 bytes} [Fri Jun 24 08:33:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:31.453608 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-d7580f86-dd92-4610-8398-17b073e0ba19 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:31.456152 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-d7580f86-dd92-4610-8398-17b073e0ba19 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002968 Jun 24 08:33:31.457033 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:31.535629 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-ad10f994-6705-4efc-bbab-36782aeb3788 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:31.560044 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-ad10f994-6705-4efc-bbab-36782aeb3788 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.096571 Jun 24 08:33:31.561316 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:33:31.576130 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-d6b23554-1ce1-4662-8dac-fe5402e0e276 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:31.603256 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-d6b23554-1ce1-4662-8dac-fe5402e0e276 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032000 Jun 24 08:33:31.604477 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1335 bytes} [Fri Jun 24 08:33:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:33.722972 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-ad10f994-6705-4efc-bbab-36782aeb3788 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:33.723977 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-ad10f994-6705-4efc-bbab-36782aeb3788 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Jun 24 08:33:33.724378 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:33.788886 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-262ddba3-d331-4f2a-a287-84d64dd4dc7c admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:33.813390 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-262ddba3-d331-4f2a-a287-84d64dd4dc7c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082089 Jun 24 08:33:33.814058 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1291 bytes} [Fri Jun 24 08:33:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:33:35.929193 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-ad10f994-6705-4efc-bbab-36782aeb3788 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:35.930229 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-ad10f994-6705-4efc-bbab-36782aeb3788 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 24 08:33:35.930628 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:35.989112 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-441f756d-0403-4010-874e-bd62c96b7614 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "disk": 1}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:36.006892 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-441f756d-0403-4010-874e-bd62c96b7614 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069798 Jun 24 08:33:36.007444 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:33:36.020737 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-597d5344-6416-4f80-b3f8-7ffe443c01d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:36.043228 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-597d5344-6416-4f80-b3f8-7ffe443c01d7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025664 Jun 24 08:33:36.043779 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1332 bytes} [Fri Jun 24 08:33:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:38.119417 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-441f756d-0403-4010-874e-bd62c96b7614 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:38.120420 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-441f756d-0403-4010-874e-bd62c96b7614 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 24 08:33:38.121307 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:38.183873 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-ba15a6d4-fd81-498b-87dd-d110adc919ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:38.203721 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-ba15a6d4-fd81-498b-87dd-d110adc919ff admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075877 Jun 24 08:33:38.204297 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:33:38.216457 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-5d6ed0f5-712f-4366-aba5-f4a82fb16914 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:38.239873 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-5d6ed0f5-712f-4366-aba5-f4a82fb16914 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027217 Jun 24 08:33:38.240446 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1332 bytes} [Fri Jun 24 08:33:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:33:40.310788 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-ba15a6d4-fd81-498b-87dd-d110adc919ff admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:40.311905 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-ba15a6d4-fd81-498b-87dd-d110adc919ff admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 24 08:33:40.312295 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:40.378040 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-ba559f52-9a04-4049-868a-6b862632fcbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "disk": 40, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:40.408942 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-ba559f52-9a04-4049-868a-6b862632fcbb admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.090190 Jun 24 08:33:40.409573 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:33:40.422671 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-990b8101-01fa-45d3-98e6-f243bfddb07c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:40.448565 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-990b8101-01fa-45d3-98e6-f243bfddb07c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030431 Jun 24 08:33:40.450050 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1332 bytes} [Fri Jun 24 08:33:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:43.172498 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-ba559f52-9a04-4049-868a-6b862632fcbb admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:43.174021 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-ba559f52-9a04-4049-868a-6b862632fcbb admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Jun 24 08:33:43.174506 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:43.235885 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-9bbf2676-b053-411c-8cab-c9b500f52272 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:43.255403 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-9bbf2676-b053-411c-8cab-c9b500f52272 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074973 Jun 24 08:33:43.255954 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:33:43.271462 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-d35a1a77-8e85-4191-b9bc-aa84979bba9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:43.300210 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-d35a1a77-8e85-4191-b9bc-aa84979bba9c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034212 Jun 24 08:33:43.300798 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1332 bytes} [Fri Jun 24 08:33:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:33:45.450578 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-9bbf2676-b053-411c-8cab-c9b500f52272 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:45.451597 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-9bbf2676-b053-411c-8cab-c9b500f52272 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002680 Jun 24 08:33:45.452001 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:33:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:45.517606 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-3c7055ca-395b-4a9d-ae88-f582905bb3ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "ram": 16384, "vcpus": 8, "id": "5", "rxtx_factor": 1.0}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:45.535655 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-3c7055ca-395b-4a9d-ae88-f582905bb3ff admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077436 Jun 24 08:33:45.536201 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1282 bytes} [Fri Jun 24 08:33:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:33:45.548627 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-98b9daf7-64ea-4895-a9eb-8da3723319db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:33:45.572860 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-98b9daf7-64ea-4895-a9eb-8da3723319db admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028031 Jun 24 08:33:45.573442 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1332 bytes} [Fri Jun 24 08:33:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:34:12.563247 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-3c7055ca-395b-4a9d-ae88-f582905bb3ff admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:12.564258 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-3c7055ca-395b-4a9d-ae88-f582905bb3ff admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 24 08:34:12.564649 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:34:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:12.571575 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:12.626078 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-dc0e5365-1d01-4509-8c0f-9996b57b46f0 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:12.644218 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-dc0e5365-1d01-4509-8c0f-9996b57b46f0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073489 Jun 24 08:34:12.644770 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1291 bytes} [Fri Jun 24 08:34:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:34:13.590702 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-3c7055ca-395b-4a9d-ae88-f582905bb3ff admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:13.591717 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-3c7055ca-395b-4a9d-ae88-f582905bb3ff admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 24 08:34:13.592119 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:34:13.782492 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-561c1e62-35b8-4b54-a5a6-90cbec8c492a admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:13.788079 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.wsgi [None req-561c1e62-35b8-4b54-a5a6-90cbec8c492a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-561c1e62-35b8-4b54-a5a6-90cbec8c492a admin admin] Request method failure captured: Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Accept: application/json Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Accept-Encoding: gzip, deflate Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Connection: keep-alive Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Content-Length: 0 Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Host: 10.222.0.13 Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Openstack-Api-Version: compute 2.90 Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Openstack-System-Scope: None Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: User-Agent: python-novaclient Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Auth-Token: gAAAAABitXcFGz0Xfnz3BC6KwAKIX-zSH7qNZyhWPpkAl6MGlR6pJKbsh87nF1UJTj8_Bc2Yk7pn7_J6z7VN664t6bCJfI_3Hpeuol0ViNhy70nF1VdtYfL1ezurl6Bh4KXPjBmZZqA6BnCccGzlbmc5Yf0STJQU9NHE5Q9-dFTq4cbidqNwr9s Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Domain-Id: None Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Domain-Name: None Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Identity-Status: Confirmed Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Is-Admin-Project: True Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Domain-Id: default Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Domain-Name: Default Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Name: admin Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Role: admin,reader,member Jun 24 08:34:13.791368 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Roles: admin,reader,member Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_985b4af5ece540be8554aecad33b1dc4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant: admin Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant-Name: admin Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User: admin Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Domain-Id: default Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Domain-Name: Default Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Id: 268e75b173ff435b8dfbe2517f69c015 Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Name: admin Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: method: > Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: exception: Flavor 42 could not be found. Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: action_args: {'id': '42'} Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:34:13.792970 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:13.795068 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.796185 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-561c1e62-35b8-4b54-a5a6-90cbec8c492a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:34:13.797212 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-561c1e62-35b8-4b54-a5a6-90cbec8c492a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064622 Jun 24 08:34:13.797212 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Fri Jun 24 08:34:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:34:13.802277 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-61af1dfd-2a4d-4f99-98ef-86c9721fad0e admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:13.805094 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:13.825296 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-61af1dfd-2a4d-4f99-98ef-86c9721fad0e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026476 Jun 24 08:34:13.825871 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Jun 24 08:34:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:34:13.835513 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-39fcbe47-b350-4213-b4d3-269f0d3514ae admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:13.859194 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-39fcbe47-b350-4213-b4d3-269f0d3514ae admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027176 Jun 24 08:34:13.859745 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Jun 24 08:34:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:34:13.869419 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-70a44dc5-2359-4824-ab7c-07a84bbc49e0 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:13.875520 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.wsgi [None req-70a44dc5-2359-4824-ab7c-07a84bbc49e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-70a44dc5-2359-4824-ab7c-07a84bbc49e0 admin admin] Request method failure captured: Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Accept: application/json Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Accept-Encoding: gzip, deflate Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Connection: keep-alive Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Content-Length: 0 Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Host: 10.222.0.13 Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Openstack-Api-Version: compute 2.90 Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Openstack-System-Scope: None Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: User-Agent: python-novaclient Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Auth-Token: gAAAAABitXcFGz0Xfnz3BC6KwAKIX-zSH7qNZyhWPpkAl6MGlR6pJKbsh87nF1UJTj8_Bc2Yk7pn7_J6z7VN664t6bCJfI_3Hpeuol0ViNhy70nF1VdtYfL1ezurl6Bh4KXPjBmZZqA6BnCccGzlbmc5Yf0STJQU9NHE5Q9-dFTq4cbidqNwr9s Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Domain-Id: None Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Domain-Name: None Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Identity-Status: Confirmed Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Is-Admin-Project: True Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Domain-Id: default Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Domain-Name: Default Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Name: admin Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Role: admin,reader,member Jun 24 08:34:13.878805 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Roles: admin,reader,member Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_985b4af5ece540be8554aecad33b1dc4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant: admin Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant-Name: admin Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User: admin Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Domain-Id: default Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Domain-Name: Default Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Id: 268e75b173ff435b8dfbe2517f69c015 Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Name: admin Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: method: > Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: exception: Flavor 42 could not be found. Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: action_args: {'id': '42'} Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:34:13.880317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:13.881219 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:13.882788 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-70a44dc5-2359-4824-ab7c-07a84bbc49e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:34:13.883977 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-70a44dc5-2359-4824-ab7c-07a84bbc49e0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014669 Jun 24 08:34:13.883977 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Fri Jun 24 08:34:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 08:34:14.707592 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-39fcbe47-b350-4213-b4d3-269f0d3514ae admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:14.708603 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-39fcbe47-b350-4213-b4d3-269f0d3514ae admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 24 08:34:14.708987 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:34:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:14.899773 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-3db26889-5cd9-4664-a2a3-733681177e4a admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:14.905646 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.wsgi [None req-3db26889-5cd9-4664-a2a3-733681177e4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-3db26889-5cd9-4664-a2a3-733681177e4a admin admin] Request method failure captured: Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Accept: application/json Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Accept-Encoding: gzip, deflate Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Connection: keep-alive Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Content-Length: 0 Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Host: 10.222.0.13 Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Openstack-Api-Version: compute 2.90 Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Openstack-System-Scope: None Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: User-Agent: python-novaclient Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Auth-Token: gAAAAABitXcGCwgH9zrEpwyI89LjIWyVQddnLjl2k-UvGq8Qmgegqm1FHDKawhIxASTzhANjyfsC7A_ru5PRiCv_FRYEmYjRYpM867kUy8fZ3wAgGS2bXra-Ozf8qZH0NWN8yYlUGRp-iZhMF--RndfKFSf4853fL_qOfSO_seC_3IzDFDsvDCI Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Domain-Id: None Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Domain-Name: None Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Identity-Status: Confirmed Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Is-Admin-Project: True Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Domain-Id: default Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Domain-Name: Default Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Name: admin Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Role: admin,reader,member Jun 24 08:34:14.907223 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Roles: admin,reader,member Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_985b4af5ece540be8554aecad33b1dc4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant: admin Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant-Name: admin Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User: admin Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Domain-Id: default Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Domain-Name: Default Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Id: 268e75b173ff435b8dfbe2517f69c015 Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Name: admin Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: method: > Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: exception: Flavor 84 could not be found. Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: action_args: {'id': '84'} Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:34:14.908761 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:14.909631 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.910736 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-3db26889-5cd9-4664-a2a3-733681177e4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:34:14.911775 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-3db26889-5cd9-4664-a2a3-733681177e4a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062508 Jun 24 08:34:14.911775 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Fri Jun 24 08:34:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:34:14.919121 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-2434ecb9-3974-4630-93b7-bb8242c12afd admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:14.933447 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-2434ecb9-3974-4630-93b7-bb8242c12afd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018754 Jun 24 08:34:14.934288 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Jun 24 08:34:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:34:14.943818 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-ae96c9df-acc9-42f6-a9e4-eca729384521 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:14.958406 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-ae96c9df-acc9-42f6-a9e4-eca729384521 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018129 Jun 24 08:34:14.958953 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Jun 24 08:34:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:34:14.968678 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-8c6c464c-0592-4e0f-9496-9400b291b39e admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:14.974039 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.wsgi [None req-8c6c464c-0592-4e0f-9496-9400b291b39e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-8c6c464c-0592-4e0f-9496-9400b291b39e admin admin] Request method failure captured: Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Accept: application/json Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Accept-Encoding: gzip, deflate Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Connection: keep-alive Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Content-Length: 0 Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Host: 10.222.0.13 Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Openstack-Api-Version: compute 2.90 Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Openstack-System-Scope: None Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: User-Agent: python-novaclient Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Auth-Token: gAAAAABitXcGCwgH9zrEpwyI89LjIWyVQddnLjl2k-UvGq8Qmgegqm1FHDKawhIxASTzhANjyfsC7A_ru5PRiCv_FRYEmYjRYpM867kUy8fZ3wAgGS2bXra-Ozf8qZH0NWN8yYlUGRp-iZhMF--RndfKFSf4853fL_qOfSO_seC_3IzDFDsvDCI Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Domain-Id: None Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Domain-Name: None Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Identity-Status: Confirmed Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Is-Admin-Project: True Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Domain-Id: default Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Domain-Name: Default Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Name: admin Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Role: admin,reader,member Jun 24 08:34:14.975532 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Roles: admin,reader,member Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_985b4af5ece540be8554aecad33b1dc4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant: admin Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant-Name: admin Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User: admin Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Domain-Id: default Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Domain-Name: Default Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Id: 268e75b173ff435b8dfbe2517f69c015 Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Name: admin Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: method: > Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: exception: Flavor 84 could not be found. Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: action_args: {'id': '84'} Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:34:14.976980 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:14.977852 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:14.979095 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-8c6c464c-0592-4e0f-9496-9400b291b39e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:34:14.980149 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-8c6c464c-0592-4e0f-9496-9400b291b39e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011795 Jun 24 08:34:14.980149 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Fri Jun 24 08:34:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:34:15.797570 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-ae96c9df-acc9-42f6-a9e4-eca729384521 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:15.798627 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-ae96c9df-acc9-42f6-a9e4-eca729384521 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 24 08:34:15.799020 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:34:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:34:15.996478 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-1dbf8552-4ff5-42bc-a2bc-21fab0a2e977 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:16.002309 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.wsgi [None req-1dbf8552-4ff5-42bc-a2bc-21fab0a2e977 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-1dbf8552-4ff5-42bc-a2bc-21fab0a2e977 admin admin] Request method failure captured: Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Accept: application/json Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Accept-Encoding: gzip, deflate Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Connection: keep-alive Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Content-Length: 0 Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Host: 10.222.0.13 Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Openstack-Api-Version: compute 2.90 Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Openstack-System-Scope: None Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: User-Agent: python-novaclient Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Auth-Token: gAAAAABitXcHOby8Qq6vJFZBgZ7syYbAKX7bpsqU-01jUc7h5vG0uxsSDxq1JDawL6S4xLbTATfX_dGARtZUop1D115mhFGcY_h1qSeHhGvVqJuDxh8qd_CpvP2kBhY5Awh7pK9YLLT2lGD3pJJi7NWgabYeWEKss3jcVcM-nRyplRWNcsLDF3Q Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Domain-Id: None Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Domain-Name: None Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Identity-Status: Confirmed Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Is-Admin-Project: True Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Domain-Id: default Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Domain-Name: Default Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Project-Name: admin Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Role: admin,reader,member Jun 24 08:34:16.003816 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Roles: admin,reader,member Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_985b4af5ece540be8554aecad33b1dc4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant: admin Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-Tenant-Name: admin Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User: admin Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Domain-Id: default Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Domain-Name: Default Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Id: 268e75b173ff435b8dfbe2517f69c015 Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: X-User-Name: admin Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: method: > Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: exception: Flavor 451 could not be found. Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: action_args: {'id': '451'} Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:34:16.005311 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:16.006258 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.007416 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-1dbf8552-4ff5-42bc-a2bc-21fab0a2e977 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:34:16.008381 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-1dbf8552-4ff5-42bc-a2bc-21fab0a2e977 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063751 Jun 24 08:34:16.008381 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Jun 24 08:34:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:34:16.015873 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-0c7671d1-9950-4282-9b57-c0ec6048051b admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:16.030116 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-0c7671d1-9950-4282-9b57-c0ec6048051b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018028 Jun 24 08:34:16.030646 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Jun 24 08:34:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:34:16.040169 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:16.053895 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017231 Jun 24 08:34:16.054434 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Fri Jun 24 08:34:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:34:16.064137 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-c969ac40-7a8b-4e9f-8ddc-ab985441f7df admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:16.069461 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.wsgi [None req-c969ac40-7a8b-4e9f-8ddc-ab985441f7df admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-c969ac40-7a8b-4e9f-8ddc-ab985441f7df admin admin] Request method failure captured: Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Accept: application/json Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Accept-Encoding: gzip, deflate Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Connection: keep-alive Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Content-Length: 0 Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Host: 10.222.0.13 Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Openstack-Api-Version: compute 2.90 Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Openstack-System-Scope: None Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: User-Agent: python-novaclient Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Auth-Token: gAAAAABitXcHOby8Qq6vJFZBgZ7syYbAKX7bpsqU-01jUc7h5vG0uxsSDxq1JDawL6S4xLbTATfX_dGARtZUop1D115mhFGcY_h1qSeHhGvVqJuDxh8qd_CpvP2kBhY5Awh7pK9YLLT2lGD3pJJi7NWgabYeWEKss3jcVcM-nRyplRWNcsLDF3Q Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Domain-Id: None Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Domain-Name: None Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Identity-Status: Confirmed Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Is-Admin-Project: True Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Domain-Id: default Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Domain-Name: Default Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Project-Name: admin Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Role: admin,reader,member Jun 24 08:34:16.070981 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Roles: admin,reader,member Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/985b4af5ece540be8554aecad33b1dc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_985b4af5ece540be8554aecad33b1dc4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant: admin Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant-Id: 985b4af5ece540be8554aecad33b1dc4 Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-Tenant-Name: admin Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User: admin Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Domain-Id: default Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Domain-Name: Default Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Id: 268e75b173ff435b8dfbe2517f69c015 Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: X-User-Name: admin Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: method: > Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: exception: Flavor 451 could not be found. Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: action_args: {'id': '451'} Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:34:16.073317 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:16.074455 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: ERROR nova.api.openstack.wsgi Jun 24 08:34:16.075715 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-c969ac40-7a8b-4e9f-8ddc-ab985441f7df admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:34:16.077157 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-c969ac40-7a8b-4e9f-8ddc-ab985441f7df admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012318 Jun 24 08:34:16.077157 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Jun 24 08:34:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 08:34:16.905662 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:16.906704 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 24 08:34:16.907105 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:34:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:17.107143 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-bf02c65c-6ba2-4548-91df-a2c62a5efb57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:17.125144 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-bf02c65c-6ba2-4548-91df-a2c62a5efb57 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.077639 Jun 24 08:34:17.125625 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Fri Jun 24 08:34:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:17.948917 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:17.949978 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 24 08:34:17.950393 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:34:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:18.141450 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-fff9c90b-720e-4d5f-98dd-bdf4c86058ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:18.159165 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-fff9c90b-720e-4d5f-98dd-bdf4c86058ba admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070426 Jun 24 08:34:18.159496 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Fri Jun 24 08:34:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:18.991940 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:18.992941 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 24 08:34:18.993965 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:19.219034 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-980f6b7b-ecbd-4e11-9706-220555e56203 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:19.236932 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-980f6b7b-ecbd-4e11-9706-220555e56203 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070275 Jun 24 08:34:19.237479 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Fri Jun 24 08:34:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:34:20.070502 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:20.072056 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Jun 24 08:34:20.072458 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:20.270643 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-85ed37f5-a088-411e-80f0-0f1b7265c021 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:20.289247 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-85ed37f5-a088-411e-80f0-0f1b7265c021 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073725 Jun 24 08:34:20.291303 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Fri Jun 24 08:34:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:21.148766 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:21.150478 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Jun 24 08:34:21.150880 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:21.344302 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-fffdf884-4964-460a-85a2-bb77cc441c28 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:21.363972 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-fffdf884-4964-460a-85a2-bb77cc441c28 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074523 Jun 24 08:34:21.364507 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Fri Jun 24 08:34:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:35:08.894568 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:08.895600 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-63ef5092-1b04-474f-a4fc-e19d7b98c346 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Jun 24 08:35:08.896004 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 930 bytes} [Fri Jun 24 08:35:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:08.906735 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:08.956518 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-47231daa-9adb-41d3-98a4-4c7ec6f6b4f3 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:08.976688 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-47231daa-9adb-41d3-98a4-4c7ec6f6b4f3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074389 Jun 24 08:35:08.977233 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1291 bytes} [Fri Jun 24 08:35:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:35:09.000193 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-73cfce30-5d60-4b30-b345-85af9edc7ba6 admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:09.004325 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG dbcounter [-] [109889] Writing DB stats nova_api:SELECT=14 {{(pid=109889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:09.010440 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-73cfce30-5d60-4b30-b345-85af9edc7ba6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013854 Jun 24 08:35:09.010991 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1282 bytes} [Fri Jun 24 08:35:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:35:09.024461 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-d4300344-945c-4580-a19f-5c5747a632c2 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:09.032523 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-d4300344-945c-4580-a19f-5c5747a632c2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012151 Jun 24 08:35:09.033057 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1285 bytes} [Fri Jun 24 08:35:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:35:09.045248 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:09.053014 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011305 Jun 24 08:35:09.053566 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1285 bytes} [Fri Jun 24 08:35:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:35:09.065457 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-13b845ce-22d5-49ee-acbc-d0aea7e0c3ab admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:09.073511 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-13b845ce-22d5-49ee-acbc-d0aea7e0c3ab admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012173 Jun 24 08:35:09.074084 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1282 bytes} [Fri Jun 24 08:35:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:38:29.471171 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:29.472220 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 24 08:38:29.472617 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:38:29.617365 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_api:SELECT=6 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:29.752939 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-b853a66b-40da-48d6-953b-b11da1b89fbb admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:29.754132 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:38:29.754132 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: warnings.warn(msg) Jun 24 08:38:29.755355 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-b853a66b-40da-48d6-953b-b11da1b89fbb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:38:29.755799 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-b853a66b-40da-48d6-953b-b11da1b89fbb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:38:29.756587 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-b853a66b-40da-48d6-953b-b11da1b89fbb admin admin] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:38:29.757022 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-b853a66b-40da-48d6-953b-b11da1b89fbb admin admin] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:38:29.791360 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-b853a66b-40da-48d6-953b-b11da1b89fbb admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.175392 Jun 24 08:38:29.791927 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 35/70] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Jun 24 08:38:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:38:30.618354 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:30.619347 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 Jun 24 08:38:30.619740 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:38:30.811270 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-30d7ca1f-353c-4ffe-bf34-932698164278 admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:30.812447 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:38:30.812447 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: warnings.warn(msg) Jun 24 08:38:30.813626 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-30d7ca1f-353c-4ffe-bf34-932698164278 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:38:30.814123 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-30d7ca1f-353c-4ffe-bf34-932698164278 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:38:30.814922 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-30d7ca1f-353c-4ffe-bf34-932698164278 admin admin] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:38:30.815356 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-30d7ca1f-353c-4ffe-bf34-932698164278 admin admin] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:38:30.835050 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-30d7ca1f-353c-4ffe-bf34-932698164278 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075443 Jun 24 08:38:30.835541 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Jun 24 08:38:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:38:42.050098 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:42.051107 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 24 08:38:42.051506 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:38:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:38:42.205375 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_cell0:SELECT=4 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:42.206144 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_cell1:SELECT=4 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:42.206752 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG dbcounter [-] [109888] Writing DB stats nova_api:SELECT=8 {{(pid=109888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:42.259605 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-f7f7f94e-4260-4d7a-9d9f-2b6856e889fc admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:42.260744 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:38:42.260744 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: warnings.warn(msg) Jun 24 08:38:42.261997 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-f7f7f94e-4260-4d7a-9d9f-2b6856e889fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:38:42.262448 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-f7f7f94e-4260-4d7a-9d9f-2b6856e889fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:38:42.263271 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-f7f7f94e-4260-4d7a-9d9f-2b6856e889fc admin admin] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:38:42.263700 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-f7f7f94e-4260-4d7a-9d9f-2b6856e889fc admin admin] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:38:42.289190 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-f7f7f94e-4260-4d7a-9d9f-2b6856e889fc admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088176 Jun 24 08:38:42.289779 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Jun 24 08:38:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:38:43.162645 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: DEBUG nova.api.openstack.wsgi [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] Calling method '>' {{(pid=109889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:43.163640 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: INFO nova.api.openstack.requestlog [None req-f2c76041-d541-44c4-aeca-df2c43fd2c8e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 24 08:38:43.164037 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: [pid: 109889|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1074 bytes} [Fri Jun 24 08:38:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:38:43.355714 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG nova.api.openstack.wsgi [None req-e8218774-f4aa-41e4-8c15-b32099793d1f admin admin] Calling method '>' {{(pid=109888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:43.356953 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:38:43.356953 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: warnings.warn(msg) Jun 24 08:38:43.358163 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-e8218774-f4aa-41e4-8c15-b32099793d1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:38:43.358600 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-e8218774-f4aa-41e4-8c15-b32099793d1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:38:43.359372 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-e8218774-f4aa-41e4-8c15-b32099793d1f admin admin] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:38:43.359792 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: DEBUG oslo_concurrency.lockutils [None req-e8218774-f4aa-41e4-8c15-b32099793d1f admin admin] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:38:43.382133 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: INFO nova.api.openstack.requestlog [None req-e8218774-f4aa-41e4-8c15-b32099793d1f admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078903 Jun 24 08:38:43.383331 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: [pid: 109888|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1193 bytes} [Fri Jun 24 08:38:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:39:40.952642 dv-cinder-847131-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 08:39:40.953875 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: Fri Jun 24 08:39:40 2022 - graceful shutdown triggered... Jun 24 08:39:40.954385 dv-cinder-847131-2-iscsi devstack@n-api.service[109889]: Gracefully killing worker 2 (pid: 109889)... Jun 24 08:39:40.954790 dv-cinder-847131-2-iscsi devstack@n-api.service[109888]: Gracefully killing worker 1 (pid: 109888)... Jun 24 08:39:41.955015 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: worker 1 buried after 1 seconds Jun 24 08:39:41.955015 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: worker 2 buried after 1 seconds Jun 24 08:39:41.955015 dv-cinder-847131-2-iscsi devstack@n-api.service[109887]: goodbye to uWSGI. Jun 24 08:39:41.956661 dv-cinder-847131-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 08:39:41.957270 dv-cinder-847131-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 08:39:41.960136 dv-cinder-847131-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 08:39:41.970101 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 08:39:41.972738 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:39:41 2022] *** Jun 24 08:39:41.972887 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:39:41.973017 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:39:41.973136 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: nodename: dv-cinder-847131-2-iscsi Jun 24 08:39:41.973252 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: machine: x86_64 Jun 24 08:39:41.973379 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: clock source: unix Jun 24 08:39:41.973488 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: pcre jit disabled Jun 24 08:39:41.973596 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: detected number of CPU cores: 4 Jun 24 08:39:41.973725 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: current working directory: / Jun 24 08:39:41.973843 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:39:41.973958 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: your processes number limit is 47680 Jun 24 08:39:41.974080 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: your memory page size is 4096 bytes Jun 24 08:39:41.974199 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: detected max file descriptor number: 2048 Jun 24 08:39:41.974320 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: lock engine: pthread robust mutexes Jun 24 08:39:41.974598 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: thunder lock: enabled Jun 24 08:39:41.974909 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 08:39:41.975129 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:39:42.022196 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: Python main interpreter initialized at 0x565555a4d9c0 Jun 24 08:39:42.022196 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: python threads support enabled Jun 24 08:39:42.022196 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: your server socket listen backlog is limited to 100 connections Jun 24 08:39:42.022196 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:39:42.022671 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:39:42.022671 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: *** Operational MODE: preforking *** Jun 24 08:39:42.022934 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:39:42.022934 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: spawned uWSGI master process (pid: 124357) Jun 24 08:39:42.023138 dv-cinder-847131-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 08:39:42.024540 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: spawned uWSGI worker 1 (pid: 124379, cores: 1) Jun 24 08:39:42.025726 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: spawned uWSGI worker 2 (pid: 124380, cores: 1) Jun 24 08:39:42.025726 dv-cinder-847131-2-iscsi devstack@n-api.service[124357]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:39:42.719311 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:39:42.723651 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:39:43.942440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:39:43.942440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: from cryptography.utils import int_from_bytes Jun 24 08:39:43.943092 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:39:43.943092 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: from cryptography.utils import int_from_bytes Jun 24 08:39:43.984361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:39:43.984361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: from cryptography.utils import int_from_bytes Jun 24 08:39:43.984928 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:39:43.984928 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: from cryptography.utils import int_from_bytes Jun 24 08:39:46.335354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:39:46.335769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:39:46.336125 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:39:46.337207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:39:46.337451 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:39:46.337856 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.338190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.338514 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.339042 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.339159 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.339462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.339901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.340086 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.340419 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.340680 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.340994 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.341327 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-2-iscsi {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.341703 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.342027 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.342338 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.342660 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.342969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.343294 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.343651 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.344109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.345568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.345568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.345568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.345568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.346277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.346277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.346424 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.346716 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.347036 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.347332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.347755 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-2-iscsi {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.348067 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.348378 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.348691 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.349106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.349422 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.349761 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.350084 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.350408 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.350730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.351041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.351362 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.351688 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.352582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.352932 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.353257 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.353572 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.353908 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.354225 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.354535 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.354799 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.355100 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.355440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.355751 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.356067 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.356317 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.356565 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.356888 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.357210 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.357518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.357858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.358166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.358474 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.358780 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.359142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.359378 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.359685 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.360011 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.360322 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.360648 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.360958 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.361275 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.361831 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.361989 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.362256 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.362601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.362921 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.363230 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.363607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.363858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.364173 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.364499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.364799 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.365120 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.365449 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.365778 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.366028 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.366330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.366636 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.366954 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.367263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.367605 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.367942 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.368814 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.369285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.369764 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.370237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.370701 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.371167 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.371621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.372100 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.372569 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.373041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.373812 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.374310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.374779 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.375827 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.376302 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.376625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.377138 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.377460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.377813 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.378155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.378472 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.378784 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.379108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.379418 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.379730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.380053 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.380356 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.380664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.380985 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.381293 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.381603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.381940 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.382245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.382549 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.382862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.383254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.384073 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.384497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.384836 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.385170 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.385491 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.385823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.386133 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.386457 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.386803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.387139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.387484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.387801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.388135 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.388465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.388784 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.389098 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.389417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.389790 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.390107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.390419 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.390776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.391051 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.391370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.391701 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.392047 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.392335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.392653 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.392968 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.393287 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.393619 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.393989 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.394301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.394642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.394998 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.395311 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.395637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.395965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.396285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.396592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.396902 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.397223 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.397556 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.397894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.398215 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.398526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.399399 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.399710 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.400023 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.400334 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.400678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.400998 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.401314 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.401626 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.401972 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.402286 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.402598 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.402910 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.403217 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.403526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.403824 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.404139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.404442 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.404767 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.405108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.405423 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.405784 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.406096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.406408 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.406719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.407028 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.407339 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.407649 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.407958 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.408262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.408586 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.408892 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.409196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.409520 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.409848 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.410153 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.410471 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.410778 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.411088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.411402 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.411713 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.412041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.412355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.412672 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.413017 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.413354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.413662 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.414236 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.414520 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.415412 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.415717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.416029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.416341 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.416650 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.416957 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.417269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.417575 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.417981 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.418288 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.418591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.418897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.419226 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.419538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.419840 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.420145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.420449 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.420799 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.421107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.421437 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.421818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.422144 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.422468 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.422783 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.423102 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.423417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.423733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.424050 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.424361 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.424682 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.424996 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.425319 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.425636 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.425993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.426303 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.426630 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.426936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.427258 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.427585 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.427927 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.428241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.428563 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.428877 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.429187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.429495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.429834 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.430191 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.430498 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.430822 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.431134 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.431453 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.431757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.432082 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.432390 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.432708 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.433012 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.433326 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.433658 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.434013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.434328 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.434642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.434960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.435272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.435587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.435899 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.436205 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.436510 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.436821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.437138 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.437451 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.437782 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.438091 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.438408 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.438717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.439023 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.439330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.439643 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.439965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.440272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.440595 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.440918 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.441222 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.441526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.441872 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.442183 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.442487 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.442793 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.443102 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.443440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.443750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.444055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.444373 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.444695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.445008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.445331 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.445786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.446014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.447831 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.448191 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.448536 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.448731 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:39:46.449147 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.449233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:39:46.449306 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.449520 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:39:46.449627 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.449880 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.449988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:39:46.450221 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.450326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:39:46.450545 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.450648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.450877 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.450988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.451200 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.451309 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.451518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.451613 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.451840 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.451943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.452171 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.452277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.452496 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.452757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.452859 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.453104 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.453198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.453385 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.453542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.453723 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.453886 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.454071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-2-iscsi {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.454241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.454385 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.454530 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.454697 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.454843 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.455013 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.455173 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.455320 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.455461 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.455631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.455791 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.455939 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.456077 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.456231 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.456379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.456590 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.456737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.456920 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.457069 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.457215 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.457362 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.457511 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.457650 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.457831 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.458014 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.458162 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.458315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.458497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.458642 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.458788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.458925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.459062 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.459238 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.459394 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.459566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.459719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.459880 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.460036 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.460183 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.460321 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-2-iscsi {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.460495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.460648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.460821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.460992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.461143 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.461829 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.462169 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.462342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.462483 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.462691 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.462860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.463007 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.463145 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.463346 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.463508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.463648 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.463793 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.463996 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.464150 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.464330 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.464488 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.464657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.464821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.464961 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.465097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.465265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.465424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.465571 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.465781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.465940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.466080 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.466226 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.466366 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.466503 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.466640 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.466794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.466933 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.467080 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.467345 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.467497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.467670 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.467824 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.468000 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.468154 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.468301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.468439 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.468588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.468736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.468882 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.469030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.469170 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.469308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.469444 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.469590 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.469766 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.469912 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.470057 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.470204 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.470350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.470497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.470648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.470788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.470925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.471070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.471235 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.471397 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.471540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.471678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.471843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.471999 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.472235 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.472394 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.472545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.472684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.472839 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.472977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.473114 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.473328 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.473469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.473613 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.473805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.473948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.474087 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.474238 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.474379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.474538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.474676 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.474821 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.474973 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.475113 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.475259 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.475398 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.475543 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.475688 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.475842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.475994 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.476146 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.476300 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.476452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.476606 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.476759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.476962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.477618 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.477793 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.478055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.478272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.478530 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.478672 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.478810 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.478948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.479103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.479257 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.479396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.479542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.479680 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.479824 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.479970 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.480122 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.480260 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.480397 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.480533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.480671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.480815 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.480976 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.481122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.481267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.481405 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.481541 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.481710 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.481868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.482008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.482153 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.482391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.482546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.482693 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.482847 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.483003 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.483142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.483288 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.483426 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.483576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.483723 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.483977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.484138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.484286 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.484431 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.484582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.484727 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.484896 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.485058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.485209 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.485357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.485593 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.485796 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.485945 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.486099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.486237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.486382 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.486521 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.486665 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.486815 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.486975 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.487131 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.487277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.487415 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.487559 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.487707 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.487851 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.487995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.488139 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.488286 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.488470 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.488626 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.488765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.488919 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.489059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.489204 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.489387 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.489543 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.489682 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.489849 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.490038 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.490186 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.490353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.490513 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.490653 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.490792 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.490947 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.491094 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.491240 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.491387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.491533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.491678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.491843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.491996 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.492145 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.492291 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.492549 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.492777 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.493022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.493250 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.493421 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.493583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.493751 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.493913 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.494059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.494203 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.494355 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:39:46.494516 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.494667 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.494812 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.494956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.495110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.495269 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.495430 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.495582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.495823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.495983 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.496145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.496291 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.496443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.496600 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.496745 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.496889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.497046 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.497200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.497346 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.497497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.497643 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.497886 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.498299 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.498464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.498610 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.498752 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.498896 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.499057 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.499227 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.499378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.499533 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.499677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.499827 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.499985 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.500137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.500288 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.500439 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.500592 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.500743 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.500900 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.501053 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.501198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.501351 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.501496 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.501648 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.502389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.502562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.502790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.503024 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.503172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.503325 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.503478 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.503632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.503779 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.503943 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.504088 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.504233 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.504384 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.504529 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.504692 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.504838 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.504982 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.505125 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.505290 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.505449 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.505607 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.505811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.506055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.506206 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.506359 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.506504 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.506662 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.506662 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.506947 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.507094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.507239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.507395 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.507541 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.507692 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.507845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.508011 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.508215 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.508460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.508690 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.508852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.509008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.509182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.509333 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.509487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.509487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.509839 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.509997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.510159 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.510316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.510475 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.510621 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.510843 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.511001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.511147 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.511299 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.511453 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.511606 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.511752 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.511905 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.512058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.512222 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.512369 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.512519 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.512672 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.512938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.512938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.513239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.513394 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.513548 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.513712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.513865 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.514010 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.514168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.514331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.514486 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.514639 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.514792 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.514947 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.515094 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.515094 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.515379 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.515532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.515532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.515827 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.515981 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.515981 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.516401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.516547 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.516700 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.516858 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.517012 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.517163 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.517311 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.517465 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.517642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.517841 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.518002 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.518147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.518292 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.518455 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.518610 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.518764 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.518909 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.519053 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.519206 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.519436 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.519591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.519745 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.519890 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.520159 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.520326 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.520485 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.520781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.520940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.521078 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.521359 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.521496 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.521736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.522010 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.522116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.522352 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.522665 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.522769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.523000 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.523094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.523312 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.523405 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.523642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.524272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.524500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.524656 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.524876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.524982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.525191 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.525331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.525523 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.525670 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.525858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.526016 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.526161 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.526341 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.526519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.526674 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.526819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.526968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.527116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.527269 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.527411 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.527558 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.527699 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.527859 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.528008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.528185 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.528376 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.528516 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.528664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.528812 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.528962 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.529155 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.529295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.529436 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.529724 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.529969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.530157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.530359 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.530529 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.530677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.530850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.531011 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.531339 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.531475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.531675 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.531821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.532008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.532331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.532495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.532646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.532828 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.532963 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.533270 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.533416 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.533591 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.533766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.533943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.534058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.534272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.534399 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.534593 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.534754 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.534921 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.535087 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.535230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.535418 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.535562 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.535862 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.536005 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.536191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.536353 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.536573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.536777 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.536879 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.537107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.537206 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.537434 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.537605 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.537807 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.537901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.538139 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.538274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.538468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.538656 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.538807 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.539042 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.539200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.539465 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.540076 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.540434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.540738 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.540886 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.541078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.541220 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.541402 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.541497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.541753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.541850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.542076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.542170 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.542410 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.542553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.542790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.542908 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.543075 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.543432 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.543606 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.543729 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.543849 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.544027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.544158 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.544388 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.544527 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.544679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.544811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.544998 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.545116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.545327 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.545446 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.545643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.545795 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.546006 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.546131 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.546330 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.546444 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.546625 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.546745 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.546940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.547066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.547258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.547377 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.547581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.547701 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.547898 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.548025 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.548216 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.548343 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.548561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.548679 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.548842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.548977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.549157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.549282 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.549468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.549594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.549803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.549937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.550205 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.550365 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.550606 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.550777 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.550888 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.550977 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.551068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.551153 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.551383 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.551522 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.551645 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.551783 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.552006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.552188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.552349 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.552503 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.552664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.552826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.552914 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.552993 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.553237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.553393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.553558 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.553788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.553932 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.554155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.554329 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.554494 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.554589 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.554754 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.554882 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.555110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.555287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.555514 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.555610 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.555837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.555952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.556168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.556281 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.556476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.556603 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.556783 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.556937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.557096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.557262 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.557404 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.557582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.557726 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.557931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.558053 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.558253 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.558355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.558583 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.558748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.558893 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.559034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.559218 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.559363 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.559536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.559774 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.559925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.560126 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.560454 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.560638 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.560779 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.560779 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.561051 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.561200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.561368 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.561502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.561634 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.561740 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.562024 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.562128 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.562351 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.562451 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.562655 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.562746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.562973 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.563080 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.563288 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.563388 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.563594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.563693 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.563899 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.564002 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.564209 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.564301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.564518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.564624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.564822 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.564921 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.565131 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.565232 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.565441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.565534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.565794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.565900 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.566105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.566197 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.566412 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.566504 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.566719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.566811 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.567032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.567132 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.567334 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.567426 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.567639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.567737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.567944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.568035 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.568247 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.568344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.568558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.568649 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.568863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.568964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.569171 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.569333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.569473 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.569573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.569819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.569912 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.570129 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.570221 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.570457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.570792 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.570895 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.570983 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.571137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.571293 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.571579 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.571729 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.571895 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.572042 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.572190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.572330 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.572496 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.572604 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.572820 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.572913 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.573132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.573222 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.573446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.573534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.573818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.573924 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.574139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.574272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.574474 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.574785 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.574903 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.575110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.575245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.575428 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.575557 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.575739 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.575866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.576057 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.576174 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.576373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.576500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.576689 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.576807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.577001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.577128 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.577310 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.577429 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.577624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.577767 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.577961 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.578078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.578272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.578424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.578757 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.579071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.579385 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.579643 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.579750 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.579977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.580068 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.580303 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.580393 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.580626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.580768 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.580940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.581100 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.581245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.581393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.581541 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.581727 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.581886 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.582017 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.582203 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.582328 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.582519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.582645 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.582845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.583039 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.583192 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.583364 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.583498 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.583643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.583814 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.583910 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.584131 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.584248 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.584440 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.584576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.584752 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.584845 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.585061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.585164 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.585374 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.585470 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.585684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.585804 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.586027 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.586144 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.586875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.587026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.587172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.587308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.587488 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.587652 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.587800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.588113 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.588212 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.588424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.588526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.588739 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.588833 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.589059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.589165 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.589368 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.589471 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.589679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.589795 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.590015 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.590157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.590328 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.590430 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.590661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.590833 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.590959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.591157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.591303 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.591495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.591591 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.591677 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.591861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.591977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.592215 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.592310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.592529 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.592622 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.592836 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.592930 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.593143 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.593245 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.593453 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.593554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.593796 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.593906 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.594151 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.594302 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.594470 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.594566 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.594790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.594903 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.595101 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.595202 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.595404 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.595496 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.595720 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.595827 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.596024 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.596123 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.596327 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.596420 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.596634 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.596739 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.596935 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.597027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.597239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.597331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.597540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.597753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.597853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.597939 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.598157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.598250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.598457 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.598550 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.598763 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.598854 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.599064 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.599210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.599368 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.599460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.599668 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.599758 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.599970 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.600061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.600269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.600361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.600598 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.600690 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.600929 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.601026 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.601224 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.601324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.601544 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.601636 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.601937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.602650 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.602814 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.602975 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.603129 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.603339 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.603492 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.603648 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.603790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.603976 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.604113 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.604312 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.604455 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.604609 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.604711 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.604932 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.605032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.605241 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.605334 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.605552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.605653 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.605889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.606006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.606244 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.606355 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.606553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.606646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.606864 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.606955 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.607195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.607296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.607523 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.607617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.607830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.607924 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.608151 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.608259 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.608472 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.608632 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.608789 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.608898 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.609103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.609338 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.609460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.609572 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.609842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.610000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.610157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.610301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.610450 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.610594 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.610734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.610989 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.611280 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.611533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.611778 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.611926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.612069 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.612211 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.612362 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.612511 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.612655 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.612799 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.612949 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.613100 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.613251 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.613393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.613545 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.613719 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.613882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.614034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.614185 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.614336 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.614478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.614626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.614767 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.614919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.615072 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.615215 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.615356 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.615507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.615650 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.615804 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.615902 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.615902 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:39:46.616122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.616222 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.616497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.616831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.617146 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.617471 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.617860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.618182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.618513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.618825 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.619162 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.619491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.619810 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.620138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.620562 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.620897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.621767 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.621767 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.621942 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.622213 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.622536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.622869 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.623451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.623764 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.624094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.624406 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.624725 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.625043 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.625374 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.625797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.626162 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.626365 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.626969 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.627153 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.627336 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.627789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.628050 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.628366 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.628708 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.629031 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.629452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.629660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.629998 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.630353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.630668 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.630997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.631335 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.631674 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.631990 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.632329 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.632663 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.632987 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.633889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.634235 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.634540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.634849 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.635168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.635479 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.635790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.636163 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.636417 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.636726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.637035 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.637346 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.637675 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.638009 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.638338 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.638654 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.638967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.639279 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.639597 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.639947 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.640257 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.640596 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.640922 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.641252 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.641586 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.641931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.642264 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.642587 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.642910 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.643237 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.643562 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.643883 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.644208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.644533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.644849 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.645172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.645495 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.645851 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.646429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.646771 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.647099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.647424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.647747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.648073 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.648399 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.648722 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.649771 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.650037 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.650360 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.650701 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.651049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.651943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.651943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.652863 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.653195 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.653526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.653900 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.654273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.654606 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.654925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.655260 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.655571 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.655894 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.656219 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.656539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.656860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.657183 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.657501 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.657852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.658172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.658494 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.658831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.659171 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.659506 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.659834 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.660154 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.660480 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.661017 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.661344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.661700 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.662162 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.662495 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.662828 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.663165 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.663545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.663837 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.664152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.664512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.664833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.665146 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.665479 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.665824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.666143 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.666473 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.666794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.667334 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.667696 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.668022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.668359 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.668694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.669022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.669339 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.669678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.670027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.670343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.670671 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.670992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.671304 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.671615 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.671931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.672250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.672559 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.672876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.673187 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.673521 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.673861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.674175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.674489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.674809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.675119 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.675431 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.675744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.676054 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.676373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.676685 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.677006 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.677315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.677636 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.677978 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.678296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.678460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Registered counter for database nova_api Jun 24 08:39:46.678660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.678993 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.679309 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.679624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.679952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.680306 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.680637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.680957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.681278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.681633 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.681987 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.682551 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.682925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.683220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.683559 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.683900 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.684215 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.684546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.684856 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.685187 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.685503 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.685885 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.686158 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.686557 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.686861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.687106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.687402 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.687729 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.694865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.694865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.694865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.694865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.694865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.694865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.694865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.694865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.696797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.696797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.696797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.696797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.696797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.696797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.696797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.696797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.697914 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.697914 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.698187 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.701721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.701721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.701721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.701721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.701721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.701721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.702210 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:39:46.702302 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.702601 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.702931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.703378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.703637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.703996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.704343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.704684 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.704997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.705315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.705627 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.705988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.706345 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.706660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.707099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.707280 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.707579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.707898 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.708211 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.708522 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.708829 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.709145 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.709482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.709809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.710119 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.710433 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.710573 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:39:46.710743 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.711037 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.711956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.712381 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.712726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.713034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.713348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.713654 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.714100 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.714444 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.714765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.715095 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.715412 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.715738 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.716053 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.716379 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.716706 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.717029 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.717344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.717684 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.718019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.718393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.718715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.719027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.719339 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.719655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.719987 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.720319 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.720629 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.720958 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.721340 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.721603 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.721954 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.722404 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.722712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.723035 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.723355 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.723666 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.723975 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.724290 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.724614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.724933 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.725262 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.725589 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.725924 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.726252 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.726580 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.726964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.727362 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.727717 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.728045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.728391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.728800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.728978 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:39:46.729219 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:39:46.771194 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.context [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9a90baf-9f7e-4d3b-8468-40fa6b0dc594(cell1) {{(pid=124380) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:39:46.776448 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:46.778072 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:46.778901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:46.780887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:46.782927 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Registered counter for database nova_cell0 Jun 24 08:39:46.786985 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Registered counter for database nova_cell1 Jun 24 08:39:46.792440 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO dbcounter [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Registered counter for database nova_api Jun 24 08:39:46.796484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:39:46.797255 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:39:46.804143 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:39:46.806939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:39:46.813234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_db.sqlalchemy.engines [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:39:46.820107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writer thread running {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:39:46.880723 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.context [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e9a90baf-9f7e-4d3b-8468-40fa6b0dc594(cell1) {{(pid=124379) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:39:46.885919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:46.887534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:46.888727 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:46.890809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:46.892925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO dbcounter [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Registered counter for database nova_cell0 Jun 24 08:39:46.897288 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO dbcounter [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Registered counter for database nova_cell1 Jun 24 08:39:46.907181 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_db.sqlalchemy.engines [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:39:46.908233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_db.sqlalchemy.engines [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:39:46.916353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writer thread running {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:39:46.916711 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writer thread running {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:39:46.988332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Registered counter for database nova_cell0 Jun 24 08:39:46.996096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:39:47.001227 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:39:47.077580 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO dbcounter [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Registered counter for database nova_cell0 Jun 24 08:39:47.086865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_db.sqlalchemy.engines [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:39:47.091680 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writer thread running {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:39:47.337950 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:39:47.345595 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:39:47.424378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: WARNING keystonemiddleware.auth_token [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:39:47.432554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: WARNING keystonemiddleware.auth_token [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:39:47.690948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:39:47.696878 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-49c9d8e3-7290-414d-b05f-8ad3dec90c28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:39:47.702277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565555a4d9c0 pid: 124380 (default app) Jun 24 08:39:47.778886 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: WARNING keystonemiddleware.auth_token [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:39:47.784962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: WARNING keystonemiddleware.auth_token [None req-534b5658-fab5-4421-94cf-0624c9990c82 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:39:47.790697 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565555a4d9c0 pid: 124379 (default app) Jun 24 08:40:29.584242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:29.587687 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:29.588699 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:29.590763 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:29.888740 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:29.889561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:29.902312 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:29.903231 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:31.340733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1a95a34a-9881-485a-bddd-f9a9c086828f tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Action: 'create', calling method: .version_select at 0x7f0a7df44700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-301978068", "metadata": {"Type": "work"}}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:31.380493 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-223bb02a-4e2d-4663-b522-d97d7c3b7aad tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Action: 'create', calling method: .version_select at 0x7f0a7df44700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1718199024", "metadata": {"Type": "work"}}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-223bb02a-4e2d-4663-b522-d97d7c3b7aad tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Request method failure captured: Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 122 Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXh9MwsO_JXfdeMqI_T6PMM4xRd68GDE6d0Q1-cMTN-qD3ggQ38FIAMiYhj19_t4RrZlLadWlsqhsav2-8j9F8G5OVxzd3QX9MX0zBuqr-Bdp1YamxwjKEhwSA8ycp8GaMtgmkOPd3o36yIdj0akEZFHI92trcueK9pLxWtK6slKSvc Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:40:31.415326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c859b23c7e2d4d5bae1d73ec8f1b32c4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 6da677ca99d34f46a9a067e0d35a8ed4 Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1718199024", "metadata": {"Type": "work"}}} Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: Jun 24 08:40:31.416694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1718199024', 'metadata': {'Type': 'work'}}}} Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:40:31.417508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:40:31.418826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:40:31.419966 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:40:31.419966 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.421762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-223bb02a-4e2d-4663-b522-d97d7c3b7aad tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:40:31.423022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-223bb02a-4e2d-4663-b522-d97d7c3b7aad tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.539575 Jun 24 08:40:31.424259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Fri Jun 24 08:40:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1543 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:40:31.436324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-33bc488c-54de-428f-8165-39055d34e566 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Action: 'create', calling method: .version_select at 0x7f0a7decf9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1833991152", "metadata": {"Type": "work"}}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-33bc488c-54de-428f-8165-39055d34e566 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Request method failure captured: Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 120 Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXh9MwsO_JXfdeMqI_T6PMM4xRd68GDE6d0Q1-cMTN-qD3ggQ38FIAMiYhj19_t4RrZlLadWlsqhsav2-8j9F8G5OVxzd3QX9MX0zBuqr-Bdp1YamxwjKEhwSA8ycp8GaMtgmkOPd3o36yIdj0akEZFHI92trcueK9pLxWtK6slKSvc Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:40:31.439484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c859b23c7e2d4d5bae1d73ec8f1b32c4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 6da677ca99d34f46a9a067e0d35a8ed4 Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1833991152", "metadata": {"Type": "work"}}} Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: Jun 24 08:40:31.440822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1833991152', 'metadata': {'Type': 'work'}}}} Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi '0' Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:40:31.441575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:40:31.443467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:40:31.445104 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:40:31.445104 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.446580 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-33bc488c-54de-428f-8165-39055d34e566 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:40:31.447662 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-33bc488c-54de-428f-8165-39055d34e566 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016292 Jun 24 08:40:31.448790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1155 bytes} [Fri Jun 24 08:40:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 08:40:31.461952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-48aaf29e-93fd-494a-a8b3-cfda5eac536b tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Action: 'create', calling method: .version_select at 0x7f0a7df44700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1400933583", "metadata": {"Type": "work"}}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-48aaf29e-93fd-494a-a8b3-cfda5eac536b tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Request method failure captured: Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 119 Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXh9MwsO_JXfdeMqI_T6PMM4xRd68GDE6d0Q1-cMTN-qD3ggQ38FIAMiYhj19_t4RrZlLadWlsqhsav2-8j9F8G5OVxzd3QX9MX0zBuqr-Bdp1YamxwjKEhwSA8ycp8GaMtgmkOPd3o36yIdj0akEZFHI92trcueK9pLxWtK6slKSvc Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:40:31.466012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c859b23c7e2d4d5bae1d73ec8f1b32c4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 6da677ca99d34f46a9a067e0d35a8ed4 Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1400933583", "metadata": {"Type": "work"}}} Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: Jun 24 08:40:31.467292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1400933583', 'metadata': {'Type': 'work'}}}} Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi '' Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:40:31.468246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:40:31.469528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:40:31.470686 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:40:31.470686 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.470686 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-48aaf29e-93fd-494a-a8b3-cfda5eac536b tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:40:31.472762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-48aaf29e-93fd-494a-a8b3-cfda5eac536b tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015897 Jun 24 08:40:31.473937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 3/3] 10.222.0.13 () {60 vars in 1155 bytes} [Fri Jun 24 08:40:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:40:31.482802 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d16a1898-95a0-43cd-86f5-253690c9f6d5 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Calling method '.version_select at 0x7f0a7dded700>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:31.905468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-d16a1898-95a0-43cd-86f5-253690c9f6d5 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] HTTP exception thrown: Volume tempest-invalid-1264422529 could not be found. Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d16a1898-95a0-43cd-86f5-253690c9f6d5 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Request method failure captured: Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1264422529 HTTP/1.1 Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXh9MwsO_JXfdeMqI_T6PMM4xRd68GDE6d0Q1-cMTN-qD3ggQ38FIAMiYhj19_t4RrZlLadWlsqhsav2-8j9F8G5OVxzd3QX9MX0zBuqr-Bdp1YamxwjKEhwSA8ycp8GaMtgmkOPd3o36yIdj0akEZFHI92trcueK9pLxWtK6slKSvc Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:40:31.911457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c859b23c7e2d4d5bae1d73ec8f1b32c4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 6da677ca99d34f46a9a067e0d35a8ed4 Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Volume tempest-invalid-1264422529 could not be found. Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'tempest-invalid-1264422529'} Jun 24 08:40:31.913403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1264422529 could not be found. (HTTP 404) (Request-ID: req-d2945227-8526-4c60-8d5f-55524af3a788) Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.914188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:40:31.915347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1264422529 could not be found. Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:40:31.916464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1264422529 could not be found. Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1264422529 could not be found. Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d16a1898-95a0-43cd-86f5-253690c9f6d5 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Returning 404 to user: Volume tempest-invalid-1264422529 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d16a1898-95a0-43cd-86f5-253690c9f6d5 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1264422529" status: 404 len: 99 microversion: 2.1 time: 0.436359 Jun 24 08:40:31.920661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 4/4] 10.222.0.13 () {58 vars in 1217 bytes} [Fri Jun 24 08:40:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1264422529 => generated 99 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 24 08:40:31.928103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d8a9ee49-8e08-43c3-978a-cc896a69d78f tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006011 Jun 24 08:40:31.932529 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 5/5] 10.222.0.13 () {58 vars in 1139 bytes} [Fri Jun 24 08:40:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 08:40:31.944118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-55c69048-4840-4773-a421-bf3a347dad97 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008367 Jun 24 08:40:31.944486 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 6/6] 10.222.0.13 () {58 vars in 1136 bytes} [Fri Jun 24 08:40:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 08:40:31.956413 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5c38626c-a3ae-45b7-b8a6-c2376b119884 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Calling method '.version_select at 0x7f0a7dd9f9d0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:31.989562 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-5c38626c-a3ae-45b7-b8a6-c2376b119884 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] HTTP exception thrown: Volume 359fa31d-4214-4f5e-b882-cb8422e24c63 could not be found. Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5c38626c-a3ae-45b7-b8a6-c2376b119884 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Request method failure captured: Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/os-volumes/359fa31d-4214-4f5e-b882-cb8422e24c63 HTTP/1.1 Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXh9MwsO_JXfdeMqI_T6PMM4xRd68GDE6d0Q1-cMTN-qD3ggQ38FIAMiYhj19_t4RrZlLadWlsqhsav2-8j9F8G5OVxzd3QX9MX0zBuqr-Bdp1YamxwjKEhwSA8ycp8GaMtgmkOPd3o36yIdj0akEZFHI92trcueK9pLxWtK6slKSvc Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:40:31.994051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c859b23c7e2d4d5bae1d73ec8f1b32c4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 6da677ca99d34f46a9a067e0d35a8ed4 Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Volume 359fa31d-4214-4f5e-b882-cb8422e24c63 could not be found. Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '359fa31d-4214-4f5e-b882-cb8422e24c63'} Jun 24 08:40:31.995443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 359fa31d-4214-4f5e-b882-cb8422e24c63 could not be found. (HTTP 404) (Request-ID: req-d4c390d7-547f-4863-8034-4511417340e7) Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:31.996308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:40:31.998526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 359fa31d-4214-4f5e-b882-cb8422e24c63 could not be found. Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:40:32.002061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 359fa31d-4214-4f5e-b882-cb8422e24c63 could not be found. Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 359fa31d-4214-4f5e-b882-cb8422e24c63 could not be found. Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5c38626c-a3ae-45b7-b8a6-c2376b119884 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Returning 404 to user: Volume 359fa31d-4214-4f5e-b882-cb8422e24c63 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5c38626c-a3ae-45b7-b8a6-c2376b119884 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/359fa31d-4214-4f5e-b882-cb8422e24c63" status: 404 len: 109 microversion: 2.1 time: 0.043972 Jun 24 08:40:32.004526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 7/7] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:40:31 2022] DELETE /compute/v2.1/os-volumes/359fa31d-4214-4f5e-b882-cb8422e24c63 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:40:32.008736 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8d843a47-da74-4c1b-8c2b-3fee843a3887 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Calling method '.version_select at 0x7f0a7decfee0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:32.079669 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-8d843a47-da74-4c1b-8c2b-3fee843a3887 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] HTTP exception thrown: Volume 9830ec24-aabc-4026-a293-9ea488eff29a could not be found. Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8d843a47-da74-4c1b-8c2b-3fee843a3887 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Request method failure captured: Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/os-volumes/9830ec24-aabc-4026-a293-9ea488eff29a HTTP/1.1 Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXh9MwsO_JXfdeMqI_T6PMM4xRd68GDE6d0Q1-cMTN-qD3ggQ38FIAMiYhj19_t4RrZlLadWlsqhsav2-8j9F8G5OVxzd3QX9MX0zBuqr-Bdp1YamxwjKEhwSA8ycp8GaMtgmkOPd3o36yIdj0akEZFHI92trcueK9pLxWtK6slKSvc Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:40:32.088236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c859b23c7e2d4d5bae1d73ec8f1b32c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c859b23c7e2d4d5bae1d73ec8f1b32c4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: c859b23c7e2d4d5bae1d73ec8f1b32c4 Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-2033597005 Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 6da677ca99d34f46a9a067e0d35a8ed4 Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-2033597005-project Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Volume 9830ec24-aabc-4026-a293-9ea488eff29a could not be found. Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '9830ec24-aabc-4026-a293-9ea488eff29a'} Jun 24 08:40:32.090579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9830ec24-aabc-4026-a293-9ea488eff29a could not be found. (HTTP 404) (Request-ID: req-d71f6a4d-20bd-4f11-961d-bbada1e7950a) Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:32.091678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:40:32.093103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9830ec24-aabc-4026-a293-9ea488eff29a could not be found. Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:40:32.094999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9830ec24-aabc-4026-a293-9ea488eff29a could not be found. Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9830ec24-aabc-4026-a293-9ea488eff29a could not be found. Jun 24 08:40:32.097923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:40:32.103180 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8d843a47-da74-4c1b-8c2b-3fee843a3887 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] Returning 404 to user: Volume 9830ec24-aabc-4026-a293-9ea488eff29a could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:40:32.104399 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8d843a47-da74-4c1b-8c2b-3fee843a3887 tempest-VolumesNegativeTest-2033597005 tempest-VolumesNegativeTest-2033597005-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9830ec24-aabc-4026-a293-9ea488eff29a" status: 404 len: 109 microversion: 2.1 time: 0.101309 Jun 24 08:40:32.105175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 8/8] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:32 2022] GET /compute/v2.1/os-volumes/9830ec24-aabc-4026-a293-9ea488eff29a => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:40:32.673303 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1a95a34a-9881-485a-bddd-f9a9c086828f tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.112324 Jun 24 08:40:32.673979 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 1/9] 10.222.0.13 () {60 vars in 1155 bytes} [Fri Jun 24 08:40:29 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3115 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 08:40:32.688132 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2e0e1a6a-57d0-4faa-8232-8eee6ca77f43 tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Calling method '.version_select at 0x7f0a7dd9f280>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:32.797703 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2e0e1a6a-57d0-4faa-8232-8eee6ca77f43 tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195" status: 200 len: 352 microversion: 2.1 time: 0.113355 Jun 24 08:40:32.802719 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 9/10] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:32 2022] GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195 => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:33.832721 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2784562f-4461-4e96-b5cf-3a1f00a5bd3c tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Calling method '.version_select at 0x7f0a7de0a550>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:33.967580 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2784562f-4461-4e96-b5cf-3a1f00a5bd3c tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195" status: 200 len: 353 microversion: 2.1 time: 0.153200 Jun 24 08:40:33.968405 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 2/11] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:33 2022] GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:33.980652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aba452bb-432d-4227-acc8-cc7cd5155258 tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Calling method '.version_select at 0x7f0a7dd9faf0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:34.097472 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aba452bb-432d-4227-acc8-cc7cd5155258 tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195" status: 200 len: 353 microversion: 2.1 time: 0.120630 Jun 24 08:40:34.098392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 10/12] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:33 2022] GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:34.110912 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dfc1890b-0260-4ca7-a2f2-953396bb6e70 tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Calling method '.version_select at 0x7f0a7de0a8b0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:34.303676 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dfc1890b-0260-4ca7-a2f2-953396bb6e70 tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195" status: 202 len: 0 microversion: 2.1 time: 0.196578 Jun 24 08:40:34.304255 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 3/13] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:40:34 2022] DELETE /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:40:34.313563 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6117257-b02d-4eff-af94-d59785d7c897 tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Calling method '.version_select at 0x7f0a7decf9d0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:34.426073 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e6117257-b02d-4eff-af94-d59785d7c897 tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195" status: 200 len: 352 microversion: 2.1 time: 0.113335 Jun 24 08:40:34.426073 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 11/14] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:34 2022] GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:35.438592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-efbf33a7-1fde-4005-aeda-73c3d076537c tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Calling method '.version_select at 0x7f0a7de0aca0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:35.487471 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-efbf33a7-1fde-4005-aeda-73c3d076537c tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] HTTP exception thrown: Volume e72619a1-9447-4116-a2c6-844c5eca1195 could not be found. Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-efbf33a7-1fde-4005-aeda-73c3d076537c tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Request method failure captured: Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195 HTTP/1.1 Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXh9Eg50GZpqpYJ9nw4Sb9r3dd7CRNDRdnl2rVv5t-oqq7n_oGUOpPI_AEq6DWvZKWVgifVofELupM04Gjzguqv5fADaawqHqBXD_el3X4lSWuz62ICLvxOqcGTOOIspNOkKBSIaB9eUOSz9cEjC04eC07bu0Y_CHJcUsPQ9xF--yPE Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 96a995413a5146d88dd2d817961a9310 Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesGetTestJSON-1606317095 Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:40:35.492157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/96a995413a5146d88dd2d817961a9310"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/96a995413a5146d88dd2d817961a9310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/96a995413a5146d88dd2d817961a9310"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_96a995413a5146d88dd2d817961a9310", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesGetTestJSON-1606317095 Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 96a995413a5146d88dd2d817961a9310 Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesGetTestJSON-1606317095 Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesGetTestJSON-1606317095-project Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 0153773c94dd40c49dd740f27a821dfe Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesGetTestJSON-1606317095-project Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Volume e72619a1-9447-4116-a2c6-844c5eca1195 could not be found. Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': 'e72619a1-9447-4116-a2c6-844c5eca1195'} Jun 24 08:40:35.493357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e72619a1-9447-4116-a2c6-844c5eca1195 could not be found. (HTTP 404) (Request-ID: req-c0dcf7b2-891d-4795-bcfc-28f57540eba4) Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:35.494137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:40:35.498693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e72619a1-9447-4116-a2c6-844c5eca1195 could not be found. Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:40:35.499748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e72619a1-9447-4116-a2c6-844c5eca1195 could not be found. Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e72619a1-9447-4116-a2c6-844c5eca1195 could not be found. Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-efbf33a7-1fde-4005-aeda-73c3d076537c tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] Returning 404 to user: Volume e72619a1-9447-4116-a2c6-844c5eca1195 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-efbf33a7-1fde-4005-aeda-73c3d076537c tempest-VolumesGetTestJSON-1606317095 tempest-VolumesGetTestJSON-1606317095-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195" status: 404 len: 109 microversion: 2.1 time: 0.061200 Jun 24 08:40:35.500766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 4/15] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:35 2022] GET /compute/v2.1/os-volumes/e72619a1-9447-4116-a2c6-844c5eca1195 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:40:41.673744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ff2856fa-2525-452e-a9a9-7cfade294109 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'create', calling method: .version_select at 0x7f0a7dd2a1f0>, body: {"keypair": {"name": "tempest-keypair-1850522714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMgRCHSdzOOoz+o671+ubCh9pQ1Ub2K/81KqxNQnAv9rcRl4sOrVUc+xGtXbYj6dscXHedVECorMYV0Diqkg0+HqVQergKftXgvly1qUO1iBAu4lIaAO/R9ApZ3nG3mkw=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:41.766105 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-ff2856fa-2525-452e-a9a9-7cfade294109 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Getting quotas for project 4de333e57ed34492bee6491335ff4356. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:40:41.780423 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-ff2856fa-2525-452e-a9a9-7cfade294109 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Getting quotas for user 75a612089b2b46a6b3ff5a6cd9e59579 and project 4de333e57ed34492bee6491335ff4356. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:40:41.890948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ff2856fa-2525-452e-a9a9-7cfade294109 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.541496 Jun 24 08:40:41.891745 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 12/16] 10.222.0.13 () {62 vars in 1199 bytes} [Fri Jun 24 08:40:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 543 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 08:40:44.072206 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b37ae27d-d7a3-4b0e-b6c9-9472375746ea tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7de23dc0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:44.214093 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b37ae27d-d7a3-4b0e-b6c9-9472375746ea tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c4cb09ec-1a99-4bf3-8461-6719cbf56192" status: 200 len: 350 microversion: 2.1 time: 0.145390 Jun 24 08:40:44.216801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 5/17] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:44 2022] GET /compute/v2.1/os-volumes/c4cb09ec-1a99-4bf3-8461-6719cbf56192 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:46.140242 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-31720f98-f7e5-4db3-8e95-43d67ff60d5f tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7dd0d820>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:46.275846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-31720f98-f7e5-4db3-8e95-43d67ff60d5f tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/db709cfd-6771-442c-92d2-fa34be9632b1" status: 200 len: 351 microversion: 2.1 time: 0.139795 Jun 24 08:40:46.284776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 13/18] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:46 2022] GET /compute/v2.1/os-volumes/db709cfd-6771-442c-92d2-fa34be9632b1 => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:49.182050 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a3dadc95-c9b5-49b6-b666-7a80f0017e89 tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7dd884c0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:49.309659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a3dadc95-c9b5-49b6-b666-7a80f0017e89 tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c2e5a1f7-2f0e-48f4-b749-d56c7498d03c" status: 200 len: 349 microversion: 2.1 time: 0.132078 Jun 24 08:40:49.317617 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 6/19] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:40:49 2022] GET /compute/v2.1/os-volumes/c2e5a1f7-2f0e-48f4-b749-d56c7498d03c => generated 349 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:49.322914 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-97cf0ddc-1995-4a06-a833-003ddf3cb73e tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7dd88b80>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:49.460396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6bd1b8b5-0e13-4022-b311-773682cf0878 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'create', calling method: .version_select at 0x7f0a7dd0de50>, body: {"keypair": {"name": "tempest-keypair-1525560488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEh1sr0oXFMA1Hvx7UsHikpcimLyk8u61K4zVA6UWdEaHZSubQgxnSQTWww1rglnI43rnh+tTujvwVXmQSw/zpcOuZtEd4k/FMAFJjyq32z6PhcT00/bzn8ZT6UJGv1vIw=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:49.484462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-97cf0ddc-1995-4a06-a833-003ddf3cb73e tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.166783 Jun 24 08:40:49.485037 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 7/20] 10.222.0.13 () {58 vars in 1133 bytes} [Fri Jun 24 08:40:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:40:49.500936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-004a874e-6314-4f86-afe4-37e031ae404a tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7de23ee0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:49.513307 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-6bd1b8b5-0e13-4022-b311-773682cf0878 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Getting quotas for project 2988ac4c59124e02bbcc7049e69dd599. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:40:49.520435 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-6bd1b8b5-0e13-4022-b311-773682cf0878 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Getting quotas for user 71cbad05d1a54b4b9959e2ebbcb720fd and project 2988ac4c59124e02bbcc7049e69dd599. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:40:49.580118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6bd1b8b5-0e13-4022-b311-773682cf0878 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.357275 Jun 24 08:40:49.581278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 14/21] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:40:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:49.782551 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-004a874e-6314-4f86-afe4-37e031ae404a tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.288235 Jun 24 08:40:49.790364 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 8/22] 10.222.0.13 () {58 vars in 1148 bytes} [Fri Jun 24 08:40:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:40:49.795611 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-56c7def8-a5a4-4fe3-9fef-30c502f0d197 tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7dd0d5e0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:50.005090 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-56c7def8-a5a4-4fe3-9fef-30c502f0d197 tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.213262 Jun 24 08:40:50.007377 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 15/23] 10.222.0.13 () {58 vars in 1133 bytes} [Fri Jun 24 08:40:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:40:50.017813 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-93ff3b9d-d830-46f4-ad9b-861ac433059c tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7dd88940>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:50.226044 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-93ff3b9d-d830-46f4-ad9b-861ac433059c tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.212476 Jun 24 08:40:50.226975 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 9/24] 10.222.0.13 () {58 vars in 1166 bytes} [Fri Jun 24 08:40:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:50.239063 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3a2ad524-703e-415f-aab2-2cd1201c097b tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7d4b6940>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:50.454207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3a2ad524-703e-415f-aab2-2cd1201c097b tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.219522 Jun 24 08:40:50.454904 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 16/25] 10.222.0.13 () {58 vars in 1169 bytes} [Fri Jun 24 08:40:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:50.467931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bc142987-1422-443f-a082-db48691e05c7 tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7dd873a0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:50.734565 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bc142987-1422-443f-a082-db48691e05c7 tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.270979 Jun 24 08:40:50.743362 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 10/26] 10.222.0.13 () {58 vars in 1154 bytes} [Fri Jun 24 08:40:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:40:50.749138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7f23f99a-46c4-42c3-a0f6-c91df98d26be tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7d4ad5e0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:51.051921 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7f23f99a-46c4-42c3-a0f6-c91df98d26be tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.308226 Jun 24 08:40:51.054093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 17/27] 10.222.0.13 () {58 vars in 1187 bytes} [Fri Jun 24 08:40:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:40:51.064951 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f3c10f8c-7379-4886-9874-4d889ce78826 tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] Calling method '.version_select at 0x7f0a7dd88550>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:51.327659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f3c10f8c-7379-4886-9874-4d889ce78826 tempest-VolumesTestJSON-284016602 tempest-VolumesTestJSON-284016602-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.266188 Jun 24 08:40:51.329814 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 11/28] 10.222.0.13 () {58 vars in 1154 bytes} [Fri Jun 24 08:40:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:40:52.291304 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-343173023", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6cb1f6d-0926-47d2-a6bc-b702c79729da"}], "security_groups": [{"name": "tempest-securitygroup--1413142175"}], "key_name": "tempest-keypair-1850522714", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:52.894271 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] validate_networks() for [('d6cb1f6d-0926-47d2-a6bc-b702c79729da', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:40:54.952528 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1939751259", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "networks": [{"uuid": "38769342-91d5-4e58-832d-8de7c3da8648"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:55.186308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] validate_networks() for [('38769342-91d5-4e58-832d-8de7c3da8648', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:40:55.575242 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:40:55.576701 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:40:55.577196 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:40:55.577661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:40:55.578145 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:40:55.601088 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:55.601551 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:55.605988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:55.606479 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:55.662959 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Getting quotas for project 4de333e57ed34492bee6491335ff4356. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:40:55.669568 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Getting quotas for user 75a612089b2b46a6b3ff5a6cd9e59579 and project 4de333e57ed34492bee6491335ff4356. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:40:55.684803 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:40:55.689606 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:40:55.826564 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1b2614f9-773e-4ecf-a3e8-ebc583fa8c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.541782 Jun 24 08:40:55.834355 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 18/29] 10.222.0.13 () {62 vars in 1187 bytes} [Fri Jun 24 08:40:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3550 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 08:40:56.728497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-280083499", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:56.898501 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] validate_networks() for [('e4e8b7d0-ce6c-4343-a961-e78a127b98d9', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:40:58.430359 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:40:58.431757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:40:58.432384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:40:58.432938 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:40:58.433494 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:40:58.465850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:58.466305 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:58.467112 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:58.467536 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:58.549448 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Getting quotas for project 147d9b38796148cb996e8c61d1586b61. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:40:58.576993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Getting quotas for user c8215c41d0c54c62b4c9fea630481000 and project 147d9b38796148cb996e8c61d1586b61. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:40:58.642500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:40:58.645864 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:40:58.702732 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:40:58.703274 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:40:58.703817 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:40:58.704162 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:40:58.704589 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:40:58.721792 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:58.724381 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:58.726673 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:58.727678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:58.793430 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7d0fb759-89f5-4874-9d46-aa61b5e56a03 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.742164 Jun 24 08:40:58.794166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 12/30] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:40:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:40:58.808120 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Getting quotas for project dfa535df5dd14d69bb3ca125cbd9fe13. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:40:58.815535 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Getting quotas for user 71e0fd73e5c9430c813af1de9ccd4a52 and project dfa535df5dd14d69bb3ca125cbd9fe13. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:40:58.819340 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-62971989", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf6a6a42-9d4a-4d09-bce3-6aaa73db62b6"}], "security_groups": [{"name": "tempest-securitygroup--1416858321"}], "key_name": "tempest-keypair-1525560488", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:40:58.831130 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:40:58.833835 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:40:58.928128 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-21a81ac1-42e9-493e-a0ec-81420279a4ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.090374 Jun 24 08:40:58.930275 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 19/31] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:40:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:40:58.938632 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:58.940005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:40:58.966478 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:58.967342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:58.969521 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:58.970227 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:59.080295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] validate_networks() for [('cf6a6a42-9d4a-4d09-bce3-6aaa73db62b6', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:40:59.488278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:40:59.530291 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:40:59.540624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:40:59.547150 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1255064c-d82e-4dab-9848-18d9f6537fce tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1333 microversion: 2.20 time: 0.615522 Jun 24 08:40:59.565461 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 20/32] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:40:58 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1333 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:40:59.598716 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8393e71d-5029-42b1-b129-7db29230f333 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:59.602453 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8393e71d-5029-42b1-b129-7db29230f333 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:40:59.759903 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8393e71d-5029-42b1-b129-7db29230f333 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:40:59.782045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8393e71d-5029-42b1-b129-7db29230f333 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1215 microversion: 2.1 time: 0.212407 Jun 24 08:40:59.782045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 21/33] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:40:59 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:40:59.786894 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d0c01912-d229-4efb-96c6-a9f1fb9bedbc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:40:59.798651 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d0c01912-d229-4efb-96c6-a9f1fb9bedbc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:00.200276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d0c01912-d229-4efb-96c6-a9f1fb9bedbc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:00.216690 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d0c01912-d229-4efb-96c6-a9f1fb9bedbc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1221 microversion: 2.1 time: 0.433990 Jun 24 08:41:00.217520 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 22/34] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:40:59 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1221 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:00.485199 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:41:00.487068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:41:00.488289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:41:00.488876 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:41:00.490370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:41:00.518998 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:00.519821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:00.523696 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:00.524967 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:00.587491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:00.588733 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:00.616583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Getting quotas for project 2988ac4c59124e02bbcc7049e69dd599. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:41:00.618754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:00.621299 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:00.625368 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:00.633770 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:00.642432 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Getting quotas for user 71cbad05d1a54b4b9959e2ebbcb720fd and project 2988ac4c59124e02bbcc7049e69dd599. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:41:00.687818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:41:00.691871 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:41:00.839631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:00.856336 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:00.859281 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:00.860746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f99e296c-688f-4400-b0f2-b43bb64fbc26 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1339 microversion: 2.20 time: 0.279583 Jun 24 08:41:00.862048 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 23/35] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:00 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:00.867288 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-eb3dc495-0f4b-48cd-aa93-65ee2f54b951 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:00.868196 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-eb3dc495-0f4b-48cd-aa93-65ee2f54b951 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:00.876480 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb3dc495-0f4b-48cd-aa93-65ee2f54b951 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:00.877408 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb3dc495-0f4b-48cd-aa93-65ee2f54b951 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:00.878508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb3dc495-0f4b-48cd-aa93-65ee2f54b951 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:00.879266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb3dc495-0f4b-48cd-aa93-65ee2f54b951 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:00.904885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-acdbd9c5-d73c-4f2b-bd80-5ea6549a2fae tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.106015 Jun 24 08:41:00.910729 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 13/36] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:40:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:41:00.939769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9465d476-accd-48d9-87ac-22bd2d16ca8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:00.943603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9465d476-accd-48d9-87ac-22bd2d16ca8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:01.121086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-eb3dc495-0f4b-48cd-aa93-65ee2f54b951 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:01.139543 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-eb3dc495-0f4b-48cd-aa93-65ee2f54b951 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1219 microversion: 2.1 time: 0.276073 Jun 24 08:41:01.142507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 24/37] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:00 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1219 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:01.167613 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-195753610", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:01.320806 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9465d476-accd-48d9-87ac-22bd2d16ca8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:01.363426 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9465d476-accd-48d9-87ac-22bd2d16ca8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1236 microversion: 2.1 time: 0.449113 Jun 24 08:41:01.368618 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 14/38] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:00 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1236 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:01.421164 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] validate_networks() for [('e4e8b7d0-ce6c-4343-a961-e78a127b98d9', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:41:01.884085 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:01.884684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:01.911045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:01.914180 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:01.914905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:01.915596 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:02.680579 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:02.709639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:02.711752 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:02.713397 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-37bc6428-76b1-4dfe-803b-7cd522a3d2c4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1339 microversion: 2.20 time: 0.834621 Jun 24 08:41:02.714607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 15/39] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:01 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1339 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:41:02.724297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-20a5adbb-7bc1-4478-b0e5-8360fc2fe467 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:02.727744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-20a5adbb-7bc1-4478-b0e5-8360fc2fe467 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:02.738901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20a5adbb-7bc1-4478-b0e5-8360fc2fe467 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:02.750620 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20a5adbb-7bc1-4478-b0e5-8360fc2fe467 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:02.751801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20a5adbb-7bc1-4478-b0e5-8360fc2fe467 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:02.752510 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20a5adbb-7bc1-4478-b0e5-8360fc2fe467 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:02.986595 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-20a5adbb-7bc1-4478-b0e5-8360fc2fe467 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:02.998348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-20a5adbb-7bc1-4478-b0e5-8360fc2fe467 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1285 microversion: 2.1 time: 0.282087 Jun 24 08:41:03.006812 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 16/40] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:02 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1285 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:03.011943 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c1b1ce1-f7fe-4ec5-acfe-f167c7e77e2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:03.017668 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c1b1ce1-f7fe-4ec5-acfe-f167c7e77e2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:03.039634 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c1b1ce1-f7fe-4ec5-acfe-f167c7e77e2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:03.040389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c1b1ce1-f7fe-4ec5-acfe-f167c7e77e2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:03.050124 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c1b1ce1-f7fe-4ec5-acfe-f167c7e77e2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:03.050729 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c1b1ce1-f7fe-4ec5-acfe-f167c7e77e2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:03.247401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:41:03.248818 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:41:03.249373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:41:03.250044 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:41:03.250602 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:41:03.270260 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:03.273250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:03.276546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:03.277229 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:03.362003 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Getting quotas for project dfa535df5dd14d69bb3ca125cbd9fe13. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:41:03.384844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Getting quotas for user 71e0fd73e5c9430c813af1de9ccd4a52 and project dfa535df5dd14d69bb3ca125cbd9fe13. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:41:03.449791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:41:03.463860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:41:03.484375 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9c1b1ce1-f7fe-4ec5-acfe-f167c7e77e2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:03.495094 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c1b1ce1-f7fe-4ec5-acfe-f167c7e77e2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1288 microversion: 2.1 time: 0.486762 Jun 24 08:41:03.498636 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 17/41] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:03 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1288 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:03.680350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9dfefb0b-1ecc-467e-ab0b-b7a1f424a475 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.536637 Jun 24 08:41:03.683387 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 25/42] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:41:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:41:03.691227 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0937d0d7-76f6-49ec-b1dc-c4398886f512 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:03.692318 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0937d0d7-76f6-49ec-b1dc-c4398886f512 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:03.739067 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:03.740384 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:03.823946 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:03.824433 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:03.831812 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:03.832289 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:04.794853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0937d0d7-76f6-49ec-b1dc-c4398886f512 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:04.804208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0937d0d7-76f6-49ec-b1dc-c4398886f512 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1221 microversion: 2.1 time: 1.116730 Jun 24 08:41:04.820576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 18/43] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:03 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1221 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:04.840857 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3e8b0f25-7a14-44b3-9dcb-7eae722a2f30 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:04.845249 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3e8b0f25-7a14-44b3-9dcb-7eae722a2f30 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:04.876444 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e8b0f25-7a14-44b3-9dcb-7eae722a2f30 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:04.876897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e8b0f25-7a14-44b3-9dcb-7eae722a2f30 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:04.877682 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e8b0f25-7a14-44b3-9dcb-7eae722a2f30 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:04.878186 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e8b0f25-7a14-44b3-9dcb-7eae722a2f30 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:05.215955 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3e8b0f25-7a14-44b3-9dcb-7eae722a2f30 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:05.229074 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3e8b0f25-7a14-44b3-9dcb-7eae722a2f30 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1273 microversion: 2.1 time: 0.404068 Jun 24 08:41:05.231987 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 19/44] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:04 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1273 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:05.261373 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5572e554-210d-4ad7-9964-84bb5367df44 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:05.263546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5572e554-210d-4ad7-9964-84bb5367df44 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:05.283778 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5572e554-210d-4ad7-9964-84bb5367df44 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:05.284243 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5572e554-210d-4ad7-9964-84bb5367df44 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:05.291385 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5572e554-210d-4ad7-9964-84bb5367df44 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:05.292020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5572e554-210d-4ad7-9964-84bb5367df44 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:05.727234 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5572e554-210d-4ad7-9964-84bb5367df44 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:05.742323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5572e554-210d-4ad7-9964-84bb5367df44 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1294 microversion: 2.1 time: 0.508511 Jun 24 08:41:05.747940 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 20/45] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:05 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1294 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:05.826815 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-75a1342e-3ae3-4cef-aab5-ed17caf63058 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:05.828225 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-75a1342e-3ae3-4cef-aab5-ed17caf63058 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:05.840156 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75a1342e-3ae3-4cef-aab5-ed17caf63058 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:05.840614 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75a1342e-3ae3-4cef-aab5-ed17caf63058 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:05.841401 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75a1342e-3ae3-4cef-aab5-ed17caf63058 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:05.850804 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75a1342e-3ae3-4cef-aab5-ed17caf63058 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:06.154128 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:06.174334 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:06.176081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:06.181876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5e34c7ae-15c4-48ea-a8c5-6eab658ac8ab tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 2.445088 Jun 24 08:41:06.193294 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 26/46] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:03 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:06.219747 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-75a1342e-3ae3-4cef-aab5-ed17caf63058 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:06.233181 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-75a1342e-3ae3-4cef-aab5-ed17caf63058 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1273 microversion: 2.1 time: 0.409944 Jun 24 08:41:06.234671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 21/47] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:05 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:06.251093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-be21ae96-f02a-4045-bec2-8f1edd028300 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:06.251751 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-be21ae96-f02a-4045-bec2-8f1edd028300 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:06.272297 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-be21ae96-f02a-4045-bec2-8f1edd028300 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:06.274875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-be21ae96-f02a-4045-bec2-8f1edd028300 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:06.277183 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-be21ae96-f02a-4045-bec2-8f1edd028300 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:06.278640 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-be21ae96-f02a-4045-bec2-8f1edd028300 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:06.454204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-be21ae96-f02a-4045-bec2-8f1edd028300 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:06.503183 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-be21ae96-f02a-4045-bec2-8f1edd028300 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1273 microversion: 2.1 time: 0.258285 Jun 24 08:41:06.519576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 27/48] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:06 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:06.761874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c7c6e805-f725-4fde-b5df-4e2a9d72617f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:06.762515 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c7c6e805-f725-4fde-b5df-4e2a9d72617f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:06.777253 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7c6e805-f725-4fde-b5df-4e2a9d72617f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:06.787292 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7c6e805-f725-4fde-b5df-4e2a9d72617f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:06.790335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7c6e805-f725-4fde-b5df-4e2a9d72617f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:06.790801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7c6e805-f725-4fde-b5df-4e2a9d72617f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:07.097932 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c7c6e805-f725-4fde-b5df-4e2a9d72617f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:07.160655 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c7c6e805-f725-4fde-b5df-4e2a9d72617f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1294 microversion: 2.1 time: 0.403084 Jun 24 08:41:07.166905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 22/49] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:06 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1294 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:07.202183 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:07.203670 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:07.215394 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:07.218785 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:07.220892 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:07.222231 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:07.255535 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b2cdbaae-2a0c-4786-a3e5-bd6f09e161a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:07.258412 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b2cdbaae-2a0c-4786-a3e5-bd6f09e161a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:07.281649 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2cdbaae-2a0c-4786-a3e5-bd6f09e161a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:07.285210 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2cdbaae-2a0c-4786-a3e5-bd6f09e161a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:07.292155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2cdbaae-2a0c-4786-a3e5-bd6f09e161a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:07.297452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2cdbaae-2a0c-4786-a3e5-bd6f09e161a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:07.777308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2cdbaae-2a0c-4786-a3e5-bd6f09e161a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:07.789495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b2cdbaae-2a0c-4786-a3e5-bd6f09e161a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1279 microversion: 2.1 time: 0.538016 Jun 24 08:41:07.790406 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 23/50] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:07 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1279 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:07.807567 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae5fbc06-a438-4cf2-845e-1ce4ebcf1afb tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:07.815105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ae5fbc06-a438-4cf2-845e-1ce4ebcf1afb tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:07.824227 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae5fbc06-a438-4cf2-845e-1ce4ebcf1afb tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:07.825245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae5fbc06-a438-4cf2-845e-1ce4ebcf1afb tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:07.827391 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae5fbc06-a438-4cf2-845e-1ce4ebcf1afb tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:07.828385 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae5fbc06-a438-4cf2-845e-1ce4ebcf1afb tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:08.150733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae5fbc06-a438-4cf2-845e-1ce4ebcf1afb tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:08.166740 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ae5fbc06-a438-4cf2-845e-1ce4ebcf1afb tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1273 microversion: 2.1 time: 0.375178 Jun 24 08:41:08.172750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 24/51] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:07 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1273 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:08.192827 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-17843b7e-3fa7-4eff-b6a1-4ed72447ea62 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:08.194508 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-17843b7e-3fa7-4eff-b6a1-4ed72447ea62 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:08.213054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17843b7e-3fa7-4eff-b6a1-4ed72447ea62 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:08.213497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17843b7e-3fa7-4eff-b6a1-4ed72447ea62 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:08.217089 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17843b7e-3fa7-4eff-b6a1-4ed72447ea62 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:08.221934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17843b7e-3fa7-4eff-b6a1-4ed72447ea62 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:08.591548 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:08.613463 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:08.620520 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:08.625969 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-00421269-9d84-4211-8ede-0507a99c95bd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 1.429671 Jun 24 08:41:08.627487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 28/52] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:07 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:08.810454 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5d0d7366-1c5f-4ac3-a5e3-74f265e50fa2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:08.811311 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5d0d7366-1c5f-4ac3-a5e3-74f265e50fa2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:08.830836 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5d0d7366-1c5f-4ac3-a5e3-74f265e50fa2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:08.837020 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5d0d7366-1c5f-4ac3-a5e3-74f265e50fa2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:08.838028 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5d0d7366-1c5f-4ac3-a5e3-74f265e50fa2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:08.838493 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5d0d7366-1c5f-4ac3-a5e3-74f265e50fa2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:09.273541 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5d0d7366-1c5f-4ac3-a5e3-74f265e50fa2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:09.301197 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5d0d7366-1c5f-4ac3-a5e3-74f265e50fa2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1279 microversion: 2.1 time: 0.495626 Jun 24 08:41:09.305487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 29/53] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:08 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1279 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:09.516750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-17843b7e-3fa7-4eff-b6a1-4ed72447ea62 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:09.531282 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-17843b7e-3fa7-4eff-b6a1-4ed72447ea62 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 1.349610 Jun 24 08:41:09.532703 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 25/54] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:08 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:09.549642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2ee64ccd-c7b5-4d4a-b6a5-7ad7920c7748 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:09.553104 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2ee64ccd-c7b5-4d4a-b6a5-7ad7920c7748 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:09.568241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ee64ccd-c7b5-4d4a-b6a5-7ad7920c7748 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:09.570797 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ee64ccd-c7b5-4d4a-b6a5-7ad7920c7748 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:09.571660 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ee64ccd-c7b5-4d4a-b6a5-7ad7920c7748 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:09.572117 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ee64ccd-c7b5-4d4a-b6a5-7ad7920c7748 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:09.611598 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-0a762b06-ce5a-4eb1-a537-f37888c1d60f req-1cb457d8-db01-417c-9f0b-6858d13ccfae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ebf6c82-2da5-46c9-8757-4fa70bfa79b1", "tag": "24b20858-8a37-47d6-98c3-e6bff8bd12c1"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:09.630950 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0a762b06-ce5a-4eb1-a537-f37888c1d60f req-1cb457d8-db01-417c-9f0b-6858d13ccfae service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:09.631784 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0a762b06-ce5a-4eb1-a537-f37888c1d60f req-1cb457d8-db01-417c-9f0b-6858d13ccfae service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:09.661542 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-0a762b06-ce5a-4eb1-a537-f37888c1d60f req-1cb457d8-db01-417c-9f0b-6858d13ccfae service nova] Creating event network-changed:24b20858-8a37-47d6-98c3-e6bff8bd12c1 for instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 on hv-cinder-84713 Jun 24 08:41:09.662671 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0a762b06-ce5a-4eb1-a537-f37888c1d60f req-1cb457d8-db01-417c-9f0b-6858d13ccfae service nova] Acquired lock "compute-rpcapi-router" {{(pid=124379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 08:41:09.664025 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8336b9e0-c80a-4d52-bbca-6ecf9764076e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:09.664846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8336b9e0-c80a-4d52-bbca-6ecf9764076e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:09.666176 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8336b9e0-c80a-4d52-bbca-6ecf9764076e None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:09.666930 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8336b9e0-c80a-4d52-bbca-6ecf9764076e None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:09.678309 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.compute.rpcapi [None req-8336b9e0-c80a-4d52-bbca-6ecf9764076e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 08:41:09.683146 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8336b9e0-c80a-4d52-bbca-6ecf9764076e None None] Releasing lock "compute-rpcapi-router" {{(pid=124379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 08:41:09.717827 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8336b9e0-c80a-4d52-bbca-6ecf9764076e None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410480 Jun 24 08:41:09.718455 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 30/55] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:09.723858 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:09.724691 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:09.738167 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:09.740458 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:09.740925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:09.741726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:09.742176 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:10.309583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2ee64ccd-c7b5-4d4a-b6a5-7ad7920c7748 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:10.332992 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2ee64ccd-c7b5-4d4a-b6a5-7ad7920c7748 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.795502 Jun 24 08:41:10.334941 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 26/56] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:09 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:10.340574 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9866aa79-9a3d-48ea-a8c0-f81f6d8d05ea tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:10.341192 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9866aa79-9a3d-48ea-a8c0-f81f6d8d05ea tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:10.346316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:10.348147 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9866aa79-9a3d-48ea-a8c0-f81f6d8d05ea tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:10.348820 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9866aa79-9a3d-48ea-a8c0-f81f6d8d05ea tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:10.349909 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9866aa79-9a3d-48ea-a8c0-f81f6d8d05ea tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:10.350353 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9866aa79-9a3d-48ea-a8c0-f81f6d8d05ea tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:10.365301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:10.367419 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:10.368788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e98814eb-2dc7-498e-ac84-de7905fea3a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.649148 Jun 24 08:41:10.369590 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 31/57] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:09 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:10.517853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9866aa79-9a3d-48ea-a8c0-f81f6d8d05ea tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:10.534897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9866aa79-9a3d-48ea-a8c0-f81f6d8d05ea tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1279 microversion: 2.1 time: 0.198270 Jun 24 08:41:10.545292 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 27/58] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:10 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1279 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:10.561499 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-98c4847f-44e7-44df-971e-6df4431df923 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:10.564823 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-98c4847f-44e7-44df-971e-6df4431df923 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:10.573943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98c4847f-44e7-44df-971e-6df4431df923 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:10.574414 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98c4847f-44e7-44df-971e-6df4431df923 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:10.575802 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98c4847f-44e7-44df-971e-6df4431df923 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:10.576429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98c4847f-44e7-44df-971e-6df4431df923 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:10.794723 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-98c4847f-44e7-44df-971e-6df4431df923 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:10.810194 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-98c4847f-44e7-44df-971e-6df4431df923 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.257153 Jun 24 08:41:10.822702 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 32/59] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:10 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:11.356890 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f8c1c954-4a14-4fdb-84ed-143797236dcd tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:11.358586 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f8c1c954-4a14-4fdb-84ed-143797236dcd tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:11.361983 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:11.371265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8c1c954-4a14-4fdb-84ed-143797236dcd tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:11.380046 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8c1c954-4a14-4fdb-84ed-143797236dcd tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:11.381395 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8c1c954-4a14-4fdb-84ed-143797236dcd tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:11.392625 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:11.393546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:11.403410 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8c1c954-4a14-4fdb-84ed-143797236dcd tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:11.419970 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:11.425014 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:11.425916 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:11.430495 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:11.943553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f8c1c954-4a14-4fdb-84ed-143797236dcd tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:11.944783 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:11.955181 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:11.956679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:11.958342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e17fe8ed-bcd9-4aaf-bfa9-c001c5f24a7f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.569232 Jun 24 08:41:11.958632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f8c1c954-4a14-4fdb-84ed-143797236dcd tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.609447 Jun 24 08:41:11.959401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 33/60] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:11 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:11.970038 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 28/61] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:11 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:11.970038 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6d624c45-43e1-4ad9-9f1b-0337b454a11f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:11.970038 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6d624c45-43e1-4ad9-9f1b-0337b454a11f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:11.979275 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9fd7b964-2249-48db-9b3d-90bbbb3810fb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:11.979789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9fd7b964-2249-48db-9b3d-90bbbb3810fb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:11.983975 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6d624c45-43e1-4ad9-9f1b-0337b454a11f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:11.984570 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6d624c45-43e1-4ad9-9f1b-0337b454a11f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:11.985478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6d624c45-43e1-4ad9-9f1b-0337b454a11f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:11.986052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6d624c45-43e1-4ad9-9f1b-0337b454a11f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:12.000702 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fd7b964-2249-48db-9b3d-90bbbb3810fb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:12.002681 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fd7b964-2249-48db-9b3d-90bbbb3810fb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:12.006155 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fd7b964-2249-48db-9b3d-90bbbb3810fb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:12.007316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fd7b964-2249-48db-9b3d-90bbbb3810fb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:12.234171 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6d624c45-43e1-4ad9-9f1b-0337b454a11f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:12.243194 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6d624c45-43e1-4ad9-9f1b-0337b454a11f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.281616 Jun 24 08:41:12.249269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 29/62] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:11 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:12.251498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9fd7b964-2249-48db-9b3d-90bbbb3810fb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:12.259790 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-89b361c7-a814-41b2-a3f7-c2f960455e43 req-34773a7b-2a81-4397-83db-8d07f537553f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5d35ce-c7be-407a-a48d-ef65f3133dbc", "tag": "5263720a-56c1-460b-8d53-95927806ac6a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:12.265208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9fd7b964-2249-48db-9b3d-90bbbb3810fb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.293476 Jun 24 08:41:12.272055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 34/63] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:11 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:12.282103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-89b361c7-a814-41b2-a3f7-c2f960455e43 req-34773a7b-2a81-4397-83db-8d07f537553f service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:12.282550 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-89b361c7-a814-41b2-a3f7-c2f960455e43 req-34773a7b-2a81-4397-83db-8d07f537553f service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:12.304077 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-89b361c7-a814-41b2-a3f7-c2f960455e43 req-34773a7b-2a81-4397-83db-8d07f537553f service nova] Creating event network-changed:5263720a-56c1-460b-8d53-95927806ac6a for instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc on hv-cinder-84713 Jun 24 08:41:12.304890 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-89b361c7-a814-41b2-a3f7-c2f960455e43 req-34773a7b-2a81-4397-83db-8d07f537553f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124380) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 08:41:12.306027 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa791f5-9f9f-45a8-b199-101521d4bae9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:12.306479 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa791f5-9f9f-45a8-b199-101521d4bae9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:12.307266 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa791f5-9f9f-45a8-b199-101521d4bae9 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:12.307691 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa791f5-9f9f-45a8-b199-101521d4bae9 None None] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:12.316737 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.compute.rpcapi [None req-0fa791f5-9f9f-45a8-b199-101521d4bae9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 08:41:12.318442 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa791f5-9f9f-45a8-b199-101521d4bae9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124380) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 08:41:12.337218 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0fa791f5-9f9f-45a8-b199-101521d4bae9 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085245 Jun 24 08:41:12.339227 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 30/64] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:12.476741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-a43cd0d8-e3ca-4254-b778-add14f89e5a8 req-a77a3230-2ca2-4c0a-9899-466b540a536c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ede17c-58db-4ce0-a48f-de711078fbee", "tag": "71b1737d-30c3-4030-bd5c-8f8f4cd87144"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:12.489991 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-a43cd0d8-e3ca-4254-b778-add14f89e5a8 req-a77a3230-2ca2-4c0a-9899-466b540a536c service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:12.492890 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-a43cd0d8-e3ca-4254-b778-add14f89e5a8 req-a77a3230-2ca2-4c0a-9899-466b540a536c service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:12.511842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-a43cd0d8-e3ca-4254-b778-add14f89e5a8 req-a77a3230-2ca2-4c0a-9899-466b540a536c service nova] Creating event network-changed:71b1737d-30c3-4030-bd5c-8f8f4cd87144 for instance 01ede17c-58db-4ce0-a48f-de711078fbee on hv-cinder-84713 Jun 24 08:41:12.521794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-a43cd0d8-e3ca-4254-b778-add14f89e5a8 req-a77a3230-2ca2-4c0a-9899-466b540a536c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252638 Jun 24 08:41:12.528113 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 35/65] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:12.977149 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3374acb8-a48a-4451-ad81-2e9807eafbf5 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:12.978045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3374acb8-a48a-4451-ad81-2e9807eafbf5 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:12.981869 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:12.985202 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:12.991340 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3374acb8-a48a-4451-ad81-2e9807eafbf5 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:12.992172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3374acb8-a48a-4451-ad81-2e9807eafbf5 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:12.993311 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3374acb8-a48a-4451-ad81-2e9807eafbf5 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:12.994321 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3374acb8-a48a-4451-ad81-2e9807eafbf5 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:13.012263 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:13.017077 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:13.021040 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:13.021940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:13.332393 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3374acb8-a48a-4451-ad81-2e9807eafbf5 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:13.359794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3374acb8-a48a-4451-ad81-2e9807eafbf5 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.371940 Jun 24 08:41:13.359794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 31/66] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:12 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:13.361190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a5b83777-4419-41fc-92e6-5fc7fa7562a0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:13.364708 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:13.369256 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a5b83777-4419-41fc-92e6-5fc7fa7562a0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:13.388630 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:13.389884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:13.391044 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2f1e11b6-567c-4834-9aca-585452058208 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.416764 Jun 24 08:41:13.396902 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5b83777-4419-41fc-92e6-5fc7fa7562a0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:13.397471 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5b83777-4419-41fc-92e6-5fc7fa7562a0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:13.400132 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 36/67] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:12 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:41:13.400960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5b83777-4419-41fc-92e6-5fc7fa7562a0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:13.404773 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5b83777-4419-41fc-92e6-5fc7fa7562a0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:13.411119 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-efea2d1d-bc62-4ccf-b79a-ec5d76e2c3a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:13.412145 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-efea2d1d-bc62-4ccf-b79a-ec5d76e2c3a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:13.423421 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=30 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:13.427852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-efea2d1d-bc62-4ccf-b79a-ec5d76e2c3a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:13.428312 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-efea2d1d-bc62-4ccf-b79a-ec5d76e2c3a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:13.432652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-efea2d1d-bc62-4ccf-b79a-ec5d76e2c3a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:13.435415 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-efea2d1d-bc62-4ccf-b79a-ec5d76e2c3a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:13.456704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:13.948704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a5b83777-4419-41fc-92e6-5fc7fa7562a0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:13.966790 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a5b83777-4419-41fc-92e6-5fc7fa7562a0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.614548 Jun 24 08:41:13.972064 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 32/68] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:13 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:14.154714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-efea2d1d-bc62-4ccf-b79a-ec5d76e2c3a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:14.173299 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-efea2d1d-bc62-4ccf-b79a-ec5d76e2c3a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.770215 Jun 24 08:41:14.176855 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 37/69] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:13 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:14.389312 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8687a229-9326-48d2-9bd3-0178a3eeab8d tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:14.392874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8687a229-9326-48d2-9bd3-0178a3eeab8d tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:14.425717 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:14.431581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:14.468233 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8687a229-9326-48d2-9bd3-0178a3eeab8d tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:14.473871 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8687a229-9326-48d2-9bd3-0178a3eeab8d tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:14.475407 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8687a229-9326-48d2-9bd3-0178a3eeab8d tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:14.476202 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8687a229-9326-48d2-9bd3-0178a3eeab8d tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:14.484524 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:14.485347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:14.497959 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:14.499177 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:14.804057 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=16 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:16.123980 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:16.168570 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:16.172601 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:16.175194 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e9643351-d6a9-40c5-9fc3-b55525d9c802 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 1.757980 Jun 24 08:41:16.189160 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 38/70] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:14 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:16.203537 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e761d1c7-5327-460d-9c0d-d700bf9edd27 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:16.218973 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e761d1c7-5327-460d-9c0d-d700bf9edd27 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:16.227315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e761d1c7-5327-460d-9c0d-d700bf9edd27 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:16.227682 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e761d1c7-5327-460d-9c0d-d700bf9edd27 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:16.228457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e761d1c7-5327-460d-9c0d-d700bf9edd27 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:16.233234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e761d1c7-5327-460d-9c0d-d700bf9edd27 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:16.314638 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:16.468518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8687a229-9326-48d2-9bd3-0178a3eeab8d tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:16.483905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8687a229-9326-48d2-9bd3-0178a3eeab8d tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 2.104396 Jun 24 08:41:16.484612 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 33/71] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:14 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:16.490338 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d9b725d5-75f6-4143-8c30-552d1042c9ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:16.491002 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d9b725d5-75f6-4143-8c30-552d1042c9ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:16.518420 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9b725d5-75f6-4143-8c30-552d1042c9ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:16.518915 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9b725d5-75f6-4143-8c30-552d1042c9ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:16.519709 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9b725d5-75f6-4143-8c30-552d1042c9ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:16.520704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9b725d5-75f6-4143-8c30-552d1042c9ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:17.012662 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e761d1c7-5327-460d-9c0d-d700bf9edd27 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:17.031374 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e761d1c7-5327-460d-9c0d-d700bf9edd27 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.840544 Jun 24 08:41:17.043961 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 39/72] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:16 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:17.104536 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d9b725d5-75f6-4143-8c30-552d1042c9ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:17.118166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d9b725d5-75f6-4143-8c30-552d1042c9ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.631618 Jun 24 08:41:17.121637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 34/73] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:16 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:17.199086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:17.199599 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:17.214402 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:17.214930 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:17.218442 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:17.219172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:17.291983 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-d2b6e5a8-93f5-4561-9326-1ac248ecab0a req-871f6435-9f35-4b2b-ab82-9363ff9d8ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02263624-79cc-4fbf-ad1d-8abe625c93e8", "tag": "19d07780-3de0-4b28-8969-232ca62ab3ff"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:17.301795 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-d2b6e5a8-93f5-4561-9326-1ac248ecab0a req-871f6435-9f35-4b2b-ab82-9363ff9d8ef6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:17.302603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-d2b6e5a8-93f5-4561-9326-1ac248ecab0a req-871f6435-9f35-4b2b-ab82-9363ff9d8ef6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:17.325344 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-d2b6e5a8-93f5-4561-9326-1ac248ecab0a req-871f6435-9f35-4b2b-ab82-9363ff9d8ef6 service nova] Creating event network-changed:19d07780-3de0-4b28-8969-232ca62ab3ff for instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 on hv-cinder-84713 Jun 24 08:41:17.347663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-d2b6e5a8-93f5-4561-9326-1ac248ecab0a req-871f6435-9f35-4b2b-ab82-9363ff9d8ef6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061815 Jun 24 08:41:17.349297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 35/74] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:17.354897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-0465b5fb-6277-48de-8f16-af50e43e2287 req-28086f5c-5906-448c-90f7-e4bdb3c71ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16405cd6-0d3f-4ea7-9972-e8d1588ff058", "tag": "e99f3915-dc1e-4d3a-8acc-b64cbbda9e3b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:17.367294 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-0465b5fb-6277-48de-8f16-af50e43e2287 req-28086f5c-5906-448c-90f7-e4bdb3c71ed5 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:17.368124 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-0465b5fb-6277-48de-8f16-af50e43e2287 req-28086f5c-5906-448c-90f7-e4bdb3c71ed5 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:17.385515 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-0465b5fb-6277-48de-8f16-af50e43e2287 req-28086f5c-5906-448c-90f7-e4bdb3c71ed5 service nova] Creating event network-changed:e99f3915-dc1e-4d3a-8acc-b64cbbda9e3b for instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 on hv-cinder-84713 Jun 24 08:41:17.393057 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-0465b5fb-6277-48de-8f16-af50e43e2287 req-28086f5c-5906-448c-90f7-e4bdb3c71ed5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042278 Jun 24 08:41:17.395495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 36/75] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:17.421667 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:17.431539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:17.433106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:17.435079 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e4f2499f-1a9d-4cc8-9b1a-8ec239dcafd4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.241393 Jun 24 08:41:17.435662 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 40/76] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:17 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:17.502575 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a77c0828-0fba-4a59-b4f3-09715b97e912 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:17.504838 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a77c0828-0fba-4a59-b4f3-09715b97e912 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:17.512464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a77c0828-0fba-4a59-b4f3-09715b97e912 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:17.513246 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a77c0828-0fba-4a59-b4f3-09715b97e912 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:17.514262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a77c0828-0fba-4a59-b4f3-09715b97e912 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:17.514852 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a77c0828-0fba-4a59-b4f3-09715b97e912 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:17.699576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a77c0828-0fba-4a59-b4f3-09715b97e912 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:17.710410 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a77c0828-0fba-4a59-b4f3-09715b97e912 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.212990 Jun 24 08:41:17.711403 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 37/77] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:17 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:18.052328 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-091e7787-adc9-42b2-a82a-eb5f0615aa9e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:18.053085 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-091e7787-adc9-42b2-a82a-eb5f0615aa9e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:18.059841 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-091e7787-adc9-42b2-a82a-eb5f0615aa9e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:18.060326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-091e7787-adc9-42b2-a82a-eb5f0615aa9e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:18.061258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-091e7787-adc9-42b2-a82a-eb5f0615aa9e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:18.061709 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-091e7787-adc9-42b2-a82a-eb5f0615aa9e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:18.145443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8e5f16e-831d-4a57-88ce-ba251d66cb5d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:18.146865 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e8e5f16e-831d-4a57-88ce-ba251d66cb5d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:18.153121 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8e5f16e-831d-4a57-88ce-ba251d66cb5d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:18.153660 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8e5f16e-831d-4a57-88ce-ba251d66cb5d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:18.154499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8e5f16e-831d-4a57-88ce-ba251d66cb5d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:18.155139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8e5f16e-831d-4a57-88ce-ba251d66cb5d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:18.238594 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-091e7787-adc9-42b2-a82a-eb5f0615aa9e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:18.246314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-091e7787-adc9-42b2-a82a-eb5f0615aa9e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.198486 Jun 24 08:41:18.247183 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 41/78] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:18 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:18.301921 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e8e5f16e-831d-4a57-88ce-ba251d66cb5d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:18.309291 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e8e5f16e-831d-4a57-88ce-ba251d66cb5d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.174193 Jun 24 08:41:18.309875 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 38/79] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:18 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:18.455284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:18.455903 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:18.462937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:18.463200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:18.466924 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:18.466924 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:18.601744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:18.609677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:18.611195 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:18.612294 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c4517649-8d03-4d07-aa8c-d936b9d3ae6f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.160905 Jun 24 08:41:18.612884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 42/80] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:18 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:18.729213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3fe6f986-1c2a-4197-9cb1-8704545c6cd8 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:18.729853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3fe6f986-1c2a-4197-9cb1-8704545c6cd8 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:18.735827 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3fe6f986-1c2a-4197-9cb1-8704545c6cd8 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:18.736272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3fe6f986-1c2a-4197-9cb1-8704545c6cd8 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:18.737031 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3fe6f986-1c2a-4197-9cb1-8704545c6cd8 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:18.737462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3fe6f986-1c2a-4197-9cb1-8704545c6cd8 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:18.865557 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3fe6f986-1c2a-4197-9cb1-8704545c6cd8 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:18.873290 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3fe6f986-1c2a-4197-9cb1-8704545c6cd8 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.147934 Jun 24 08:41:18.873887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 39/81] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:18 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:19.263913 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-37a4f988-3b87-4a1d-8e09-a41e4a9acd63 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:19.264528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-37a4f988-3b87-4a1d-8e09-a41e4a9acd63 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:19.270978 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-37a4f988-3b87-4a1d-8e09-a41e4a9acd63 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:19.271427 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-37a4f988-3b87-4a1d-8e09-a41e4a9acd63 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:19.272186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-37a4f988-3b87-4a1d-8e09-a41e4a9acd63 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:19.272641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-37a4f988-3b87-4a1d-8e09-a41e4a9acd63 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:19.326591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d31ac34e-b0cd-4063-8bc7-a50f5d58396d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:19.327287 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d31ac34e-b0cd-4063-8bc7-a50f5d58396d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:19.333457 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d31ac34e-b0cd-4063-8bc7-a50f5d58396d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:19.334116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d31ac34e-b0cd-4063-8bc7-a50f5d58396d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:19.334730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d31ac34e-b0cd-4063-8bc7-a50f5d58396d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:19.335278 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d31ac34e-b0cd-4063-8bc7-a50f5d58396d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:19.461735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-37a4f988-3b87-4a1d-8e09-a41e4a9acd63 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:19.469874 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-37a4f988-3b87-4a1d-8e09-a41e4a9acd63 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.209445 Jun 24 08:41:19.480819 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 43/82] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:19 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:19.513658 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d31ac34e-b0cd-4063-8bc7-a50f5d58396d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:19.521616 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d31ac34e-b0cd-4063-8bc7-a50f5d58396d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.198881 Jun 24 08:41:19.522211 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 40/83] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:19 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:19.631590 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:19.632514 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:19.638660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:19.639116 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:19.639881 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:19.640321 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:19.676646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=8 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:19.778333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:19.786706 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:19.788207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:19.789310 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f258119e-7846-4634-a7be-70901924b0ac tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.162277 Jun 24 08:41:19.789917 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 44/84] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:19 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:19.890788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-07f06270-480a-4897-b9fd-d686fbcc5461 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:19.892125 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-07f06270-480a-4897-b9fd-d686fbcc5461 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:19.898389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f06270-480a-4897-b9fd-d686fbcc5461 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:19.898834 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f06270-480a-4897-b9fd-d686fbcc5461 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:19.899606 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f06270-480a-4897-b9fd-d686fbcc5461 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:19.900040 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f06270-480a-4897-b9fd-d686fbcc5461 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:20.038583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-07f06270-480a-4897-b9fd-d686fbcc5461 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:20.045847 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-07f06270-480a-4897-b9fd-d686fbcc5461 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.159026 Jun 24 08:41:20.046421 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 41/85] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:19 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:20.488201 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-eb40cbf3-b943-44e6-9a9d-4794077aa46b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:20.489437 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-eb40cbf3-b943-44e6-9a9d-4794077aa46b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:20.495920 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb40cbf3-b943-44e6-9a9d-4794077aa46b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:20.497910 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb40cbf3-b943-44e6-9a9d-4794077aa46b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:20.497910 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb40cbf3-b943-44e6-9a9d-4794077aa46b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:20.498137 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb40cbf3-b943-44e6-9a9d-4794077aa46b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:20.540610 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9199710b-3a35-4b38-968f-1c80f364e5b2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:20.541779 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9199710b-3a35-4b38-968f-1c80f364e5b2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:20.548980 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9199710b-3a35-4b38-968f-1c80f364e5b2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:20.550767 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9199710b-3a35-4b38-968f-1c80f364e5b2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:20.553745 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9199710b-3a35-4b38-968f-1c80f364e5b2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:20.554435 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9199710b-3a35-4b38-968f-1c80f364e5b2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:20.840546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-eb40cbf3-b943-44e6-9a9d-4794077aa46b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:20.850782 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-eb40cbf3-b943-44e6-9a9d-4794077aa46b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.366203 Jun 24 08:41:20.852001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 45/86] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:20 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:20.867249 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:20.868138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:20.869208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9199710b-3a35-4b38-968f-1c80f364e5b2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:20.876697 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:20.877243 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:20.878076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:20.878516 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:20.880363 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9199710b-3a35-4b38-968f-1c80f364e5b2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.345747 Jun 24 08:41:20.882526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 42/87] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:20 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:21.033346 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:21.042147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:21.043759 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:21.044867 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f8e048e2-b891-4ee1-b968-ab5c25379136 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.191714 Jun 24 08:41:21.045443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 46/88] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:20 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:21.067118 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0f4294d5-5e02-4237-b8be-053e622e11d4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:21.067854 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0f4294d5-5e02-4237-b8be-053e622e11d4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:21.073959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f4294d5-5e02-4237-b8be-053e622e11d4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:21.074550 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f4294d5-5e02-4237-b8be-053e622e11d4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:21.075316 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f4294d5-5e02-4237-b8be-053e622e11d4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:21.075921 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f4294d5-5e02-4237-b8be-053e622e11d4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:21.206136 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0f4294d5-5e02-4237-b8be-053e622e11d4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:21.215926 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0f4294d5-5e02-4237-b8be-053e622e11d4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.153650 Jun 24 08:41:21.216713 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 43/89] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:21 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:21.868618 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5650d191-f71f-45f5-82c2-8690b499f72c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:21.869150 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5650d191-f71f-45f5-82c2-8690b499f72c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:21.875472 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5650d191-f71f-45f5-82c2-8690b499f72c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:21.875919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5650d191-f71f-45f5-82c2-8690b499f72c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:21.876677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5650d191-f71f-45f5-82c2-8690b499f72c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:21.877111 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5650d191-f71f-45f5-82c2-8690b499f72c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:21.899086 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-067a0b61-339f-4e95-aba3-595379b5622a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:21.899808 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-067a0b61-339f-4e95-aba3-595379b5622a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:21.902867 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:21.906791 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067a0b61-339f-4e95-aba3-595379b5622a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:21.907240 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067a0b61-339f-4e95-aba3-595379b5622a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:21.908207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067a0b61-339f-4e95-aba3-595379b5622a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:21.908637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067a0b61-339f-4e95-aba3-595379b5622a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:22.103825 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5650d191-f71f-45f5-82c2-8690b499f72c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:22.120744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-067a0b61-339f-4e95-aba3-595379b5622a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:22.134195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-067a0b61-339f-4e95-aba3-595379b5622a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.239120 Jun 24 08:41:22.134792 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 44/90] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:21 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:22.138922 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5650d191-f71f-45f5-82c2-8690b499f72c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.273955 Jun 24 08:41:22.139610 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:22.140401 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:22.140774 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 47/91] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:21 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:22.146519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:22.146958 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:22.147711 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:22.148141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:22.233762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1bd4c8da-9bf2-4a7a-b11b-09f62c5de417 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:22.234388 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1bd4c8da-9bf2-4a7a-b11b-09f62c5de417 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:22.241105 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1bd4c8da-9bf2-4a7a-b11b-09f62c5de417 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:22.241556 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1bd4c8da-9bf2-4a7a-b11b-09f62c5de417 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:22.242368 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1bd4c8da-9bf2-4a7a-b11b-09f62c5de417 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:22.242810 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1bd4c8da-9bf2-4a7a-b11b-09f62c5de417 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:22.286265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:22.294913 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:22.296528 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:22.297762 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2881334a-921b-4b61-81af-92e73ff67ede tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.161845 Jun 24 08:41:22.298412 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 45/92] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:22 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:22.385360 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1bd4c8da-9bf2-4a7a-b11b-09f62c5de417 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:22.393099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1bd4c8da-9bf2-4a7a-b11b-09f62c5de417 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.163207 Jun 24 08:41:22.393681 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:22 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:23.150987 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-318bf805-1994-4202-b5f9-127f70707fd7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:23.151585 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-318bf805-1994-4202-b5f9-127f70707fd7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:23.153641 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:23.157737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a377cfd6-afe4-4890-85d9-f7f4840c82ef tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:23.158497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a377cfd6-afe4-4890-85d9-f7f4840c82ef tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:23.158995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-318bf805-1994-4202-b5f9-127f70707fd7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:23.159450 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-318bf805-1994-4202-b5f9-127f70707fd7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:23.160220 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-318bf805-1994-4202-b5f9-127f70707fd7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:23.160693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-318bf805-1994-4202-b5f9-127f70707fd7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:23.165192 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a377cfd6-afe4-4890-85d9-f7f4840c82ef tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:23.165643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a377cfd6-afe4-4890-85d9-f7f4840c82ef tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:23.166451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a377cfd6-afe4-4890-85d9-f7f4840c82ef tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:23.166889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a377cfd6-afe4-4890-85d9-f7f4840c82ef tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:23.359274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-318bf805-1994-4202-b5f9-127f70707fd7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:23.363334 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a377cfd6-afe4-4890-85d9-f7f4840c82ef tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:23.367704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-318bf805-1994-4202-b5f9-127f70707fd7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.220498 Jun 24 08:41:23.368299 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 46/94] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:23 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:23.372776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a377cfd6-afe4-4890-85d9-f7f4840c82ef tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.218951 Jun 24 08:41:23.373037 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:23.373658 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:23.374061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 49/95] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:23 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:23.380067 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:23.380511 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:23.381281 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:23.381736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:23.410188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8d50fb49-88a8-451a-a503-c22f8bec490e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:23.411312 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8d50fb49-88a8-451a-a503-c22f8bec490e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:23.417314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d50fb49-88a8-451a-a503-c22f8bec490e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:23.417790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d50fb49-88a8-451a-a503-c22f8bec490e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:23.418550 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d50fb49-88a8-451a-a503-c22f8bec490e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:23.418980 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d50fb49-88a8-451a-a503-c22f8bec490e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:23.578820 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:23.587129 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:23.588738 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:23.589976 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d8d26f8d-adad-4c6d-9926-afff363080bc tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.220717 Jun 24 08:41:23.590620 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 47/96] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:23 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:23.605342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8d50fb49-88a8-451a-a503-c22f8bec490e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:23.612757 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8d50fb49-88a8-451a-a503-c22f8bec490e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.206259 Jun 24 08:41:23.613268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 50/97] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:23 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:24.402207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-10b83b8e-3c0d-4abb-a506-f3d9d561916d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:24.403011 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8bb0d7a-74d6-47a6-bfb6-d9c1be12617d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:24.404584 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-10b83b8e-3c0d-4abb-a506-f3d9d561916d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:24.405289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e8bb0d7a-74d6-47a6-bfb6-d9c1be12617d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:24.424258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-10b83b8e-3c0d-4abb-a506-f3d9d561916d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:24.424788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8bb0d7a-74d6-47a6-bfb6-d9c1be12617d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:24.425419 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-10b83b8e-3c0d-4abb-a506-f3d9d561916d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:24.427301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8bb0d7a-74d6-47a6-bfb6-d9c1be12617d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:24.428831 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8bb0d7a-74d6-47a6-bfb6-d9c1be12617d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:24.429643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-10b83b8e-3c0d-4abb-a506-f3d9d561916d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:24.430753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-10b83b8e-3c0d-4abb-a506-f3d9d561916d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:24.431033 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8bb0d7a-74d6-47a6-bfb6-d9c1be12617d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:24.876992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-10b83b8e-3c0d-4abb-a506-f3d9d561916d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:24.889934 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-10b83b8e-3c0d-4abb-a506-f3d9d561916d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.502270 Jun 24 08:41:24.901324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 51/98] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:24 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:24.901324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:24.901324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:24.916974 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e8bb0d7a-74d6-47a6-bfb6-d9c1be12617d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:24.918861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:24.921864 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:24.922812 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:24.924426 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:24.930167 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e8bb0d7a-74d6-47a6-bfb6-d9c1be12617d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.547436 Jun 24 08:41:24.931399 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 48/99] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:24 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:24.937091 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1badc6c1-9568-49be-86f8-658d5e15f293 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:24.937963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1badc6c1-9568-49be-86f8-658d5e15f293 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:24.946386 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1badc6c1-9568-49be-86f8-658d5e15f293 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:24.947119 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1badc6c1-9568-49be-86f8-658d5e15f293 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:24.948523 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1badc6c1-9568-49be-86f8-658d5e15f293 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:24.949852 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1badc6c1-9568-49be-86f8-658d5e15f293 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:25.255694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:25.257935 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1badc6c1-9568-49be-86f8-658d5e15f293 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:25.265473 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:25.267624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:25.268765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-25f17754-387d-49a9-be80-e285f1977969 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.375239 Jun 24 08:41:25.273545 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1badc6c1-9568-49be-86f8-658d5e15f293 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.340237 Jun 24 08:41:25.275156 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 49/100] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:24 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:25.280574 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 52/101] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:24 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:25.908345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3b570c3b-54d6-4e92-88d7-49f62275665f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:25.908959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3b570c3b-54d6-4e92-88d7-49f62275665f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:25.918076 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b570c3b-54d6-4e92-88d7-49f62275665f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:25.918412 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b570c3b-54d6-4e92-88d7-49f62275665f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:25.920513 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b570c3b-54d6-4e92-88d7-49f62275665f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:25.921140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b570c3b-54d6-4e92-88d7-49f62275665f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:25.927183 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:25.953554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7e786fd7-3b6e-4251-a4f5-ef131c9ca8a8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:25.954637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7e786fd7-3b6e-4251-a4f5-ef131c9ca8a8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:25.976144 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7e786fd7-3b6e-4251-a4f5-ef131c9ca8a8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:25.977206 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7e786fd7-3b6e-4251-a4f5-ef131c9ca8a8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:25.978762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7e786fd7-3b6e-4251-a4f5-ef131c9ca8a8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:25.979672 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7e786fd7-3b6e-4251-a4f5-ef131c9ca8a8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:26.407941 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3b570c3b-54d6-4e92-88d7-49f62275665f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:26.421510 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3b570c3b-54d6-4e92-88d7-49f62275665f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.516492 Jun 24 08:41:26.423224 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 50/102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:25 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:26.431259 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:26.432222 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:26.443066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:26.443775 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:26.445515 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:26.446378 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:26.515594 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7e786fd7-3b6e-4251-a4f5-ef131c9ca8a8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:26.526515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7e786fd7-3b6e-4251-a4f5-ef131c9ca8a8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.579396 Jun 24 08:41:26.532376 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 53/103] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:25 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:26.538120 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0ae4ec48-7bee-4bea-b8e8-99fb3d3bbc00 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:26.540747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0ae4ec48-7bee-4bea-b8e8-99fb3d3bbc00 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:26.554893 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ae4ec48-7bee-4bea-b8e8-99fb3d3bbc00 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:26.555547 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ae4ec48-7bee-4bea-b8e8-99fb3d3bbc00 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:26.559882 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ae4ec48-7bee-4bea-b8e8-99fb3d3bbc00 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:26.560501 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ae4ec48-7bee-4bea-b8e8-99fb3d3bbc00 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:27.103631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0ae4ec48-7bee-4bea-b8e8-99fb3d3bbc00 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:27.121873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0ae4ec48-7bee-4bea-b8e8-99fb3d3bbc00 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.580090 Jun 24 08:41:27.123904 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 54/104] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:26 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:27.132707 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:27.147184 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:27.149758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:27.156062 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2f75842d-ee25-44ab-9cbd-0eab4d0e3529 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.726712 Jun 24 08:41:27.156898 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 51/105] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:26 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:27.440116 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dde7329d-52bd-4e0e-82a6-5391b28be35b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:27.441167 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dde7329d-52bd-4e0e-82a6-5391b28be35b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:27.450817 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dde7329d-52bd-4e0e-82a6-5391b28be35b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:27.452586 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dde7329d-52bd-4e0e-82a6-5391b28be35b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:27.454301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dde7329d-52bd-4e0e-82a6-5391b28be35b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:27.454749 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dde7329d-52bd-4e0e-82a6-5391b28be35b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:27.547267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ffdcb307-5e63-4735-bba3-dbd12150b6cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:27.547887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ffdcb307-5e63-4735-bba3-dbd12150b6cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:27.555932 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffdcb307-5e63-4735-bba3-dbd12150b6cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:27.556856 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffdcb307-5e63-4735-bba3-dbd12150b6cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:27.557816 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffdcb307-5e63-4735-bba3-dbd12150b6cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:27.558394 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffdcb307-5e63-4735-bba3-dbd12150b6cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:27.759277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dde7329d-52bd-4e0e-82a6-5391b28be35b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:27.767067 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dde7329d-52bd-4e0e-82a6-5391b28be35b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.331583 Jun 24 08:41:27.770061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 55/106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:27 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:27.850759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ffdcb307-5e63-4735-bba3-dbd12150b6cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:27.861350 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ffdcb307-5e63-4735-bba3-dbd12150b6cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.321884 Jun 24 08:41:27.862136 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 52/107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:27 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:27.941184 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-c07e6358-3220-4267-a7ad-f3ae68de01ec req-e2b85c45-e090-432b-9f49-015c23ccc6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ede17c-58db-4ce0-a48f-de711078fbee", "name": "network-vif-plugged", "status": "completed", "tag": "71b1737d-30c3-4030-bd5c-8f8f4cd87144"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:27.960078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c07e6358-3220-4267-a7ad-f3ae68de01ec req-e2b85c45-e090-432b-9f49-015c23ccc6cc service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:27.960888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c07e6358-3220-4267-a7ad-f3ae68de01ec req-e2b85c45-e090-432b-9f49-015c23ccc6cc service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:27.979157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:27.982429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-c07e6358-3220-4267-a7ad-f3ae68de01ec req-e2b85c45-e090-432b-9f49-015c23ccc6cc service nova] Creating event network-vif-plugged:71b1737d-30c3-4030-bd5c-8f8f4cd87144 for instance 01ede17c-58db-4ce0-a48f-de711078fbee on hv-cinder-84713 Jun 24 08:41:27.992448 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-c07e6358-3220-4267-a7ad-f3ae68de01ec req-e2b85c45-e090-432b-9f49-015c23ccc6cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220523 Jun 24 08:41:28.000061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 56/108] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:28.141045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-058a91f0-b7cb-4889-9b8b-acb98841bf22 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:28.141846 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-058a91f0-b7cb-4889-9b8b-acb98841bf22 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:28.159960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-058a91f0-b7cb-4889-9b8b-acb98841bf22 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:28.162639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-058a91f0-b7cb-4889-9b8b-acb98841bf22 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:28.167796 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-058a91f0-b7cb-4889-9b8b-acb98841bf22 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:28.168413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-058a91f0-b7cb-4889-9b8b-acb98841bf22 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:28.179353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:28.180265 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:28.195720 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:28.196611 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:28.197572 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:28.199040 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:28.971754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:28.991607 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:28.993291 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:28.994378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d6aa2b1c-3113-413b-99cc-46a3f3738068 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.822962 Jun 24 08:41:28.994946 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 57/109] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:28 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:41:29.001623 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-058a91f0-b7cb-4889-9b8b-acb98841bf22 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:29.004940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ad1198d9-800b-45e5-bf14-4c53c5c09f00 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:29.013383 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ad1198d9-800b-45e5-bf14-4c53c5c09f00 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:29.024029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-058a91f0-b7cb-4889-9b8b-acb98841bf22 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.886431 Jun 24 08:41:29.028367 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 53/110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:28 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:29.034146 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad1198d9-800b-45e5-bf14-4c53c5c09f00 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:29.034598 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad1198d9-800b-45e5-bf14-4c53c5c09f00 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:29.035406 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad1198d9-800b-45e5-bf14-4c53c5c09f00 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:29.035859 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad1198d9-800b-45e5-bf14-4c53c5c09f00 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:29.037201 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e094f391-b6d0-41a0-ab5b-bea3136735d2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:29.038556 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e094f391-b6d0-41a0-ab5b-bea3136735d2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:29.060003 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e094f391-b6d0-41a0-ab5b-bea3136735d2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:29.061829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e094f391-b6d0-41a0-ab5b-bea3136735d2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:29.063801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e094f391-b6d0-41a0-ab5b-bea3136735d2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:29.064619 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e094f391-b6d0-41a0-ab5b-bea3136735d2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:29.484189 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ad1198d9-800b-45e5-bf14-4c53c5c09f00 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:29.493132 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ad1198d9-800b-45e5-bf14-4c53c5c09f00 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.492403 Jun 24 08:41:29.499190 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 58/111] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:28 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:29.509585 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e094f391-b6d0-41a0-ab5b-bea3136735d2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:29.516204 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e094f391-b6d0-41a0-ab5b-bea3136735d2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.485438 Jun 24 08:41:29.516881 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 54/112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:29 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:30.022620 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:30.023346 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:30.029604 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:30.030081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:30.030978 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:30.031513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:30.044965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-999d9372-4b97-4c13-b366-4a848a5b77d0 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:30.045447 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-999d9372-4b97-4c13-b366-4a848a5b77d0 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:30.052046 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-999d9372-4b97-4c13-b366-4a848a5b77d0 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:30.052487 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-999d9372-4b97-4c13-b366-4a848a5b77d0 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:30.053285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-999d9372-4b97-4c13-b366-4a848a5b77d0 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:30.053739 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-999d9372-4b97-4c13-b366-4a848a5b77d0 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:30.271913 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:30.275444 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-999d9372-4b97-4c13-b366-4a848a5b77d0 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:30.286087 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:30.287950 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:30.288166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-999d9372-4b97-4c13-b366-4a848a5b77d0 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.247371 Jun 24 08:41:30.289375 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-254edb6a-72d9-4f95-ab7f-4b800437c3ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.279595 Jun 24 08:41:30.290362 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 59/113] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:30 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:41:30.294342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 55/114] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:30 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:30.516967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a7c20172-d2a2-4a7f-90c6-b8efad88d15f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:30.517913 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a7c20172-d2a2-4a7f-90c6-b8efad88d15f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:30.525198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a7c20172-d2a2-4a7f-90c6-b8efad88d15f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:30.527530 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a7c20172-d2a2-4a7f-90c6-b8efad88d15f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:30.528574 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a7c20172-d2a2-4a7f-90c6-b8efad88d15f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:30.529216 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a7c20172-d2a2-4a7f-90c6-b8efad88d15f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:30.535415 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0f3156b2-225d-4409-9c1d-ee759b58c27d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:30.536275 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0f3156b2-225d-4409-9c1d-ee759b58c27d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:30.546248 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f3156b2-225d-4409-9c1d-ee759b58c27d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:30.546996 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f3156b2-225d-4409-9c1d-ee759b58c27d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:30.547783 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f3156b2-225d-4409-9c1d-ee759b58c27d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:30.548213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f3156b2-225d-4409-9c1d-ee759b58c27d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:30.740956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a7c20172-d2a2-4a7f-90c6-b8efad88d15f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:30.757327 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a7c20172-d2a2-4a7f-90c6-b8efad88d15f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.244591 Jun 24 08:41:30.775777 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 60/115] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:30 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:30.842053 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0f3156b2-225d-4409-9c1d-ee759b58c27d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:30.866987 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0f3156b2-225d-4409-9c1d-ee759b58c27d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.336888 Jun 24 08:41:30.869732 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 56/116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:30 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:31.117212 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-963e9544-7918-46ac-9755-cc070aff21c7 req-eb8f4ae6-35d0-4293-a5d5-30a4f39883e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5d35ce-c7be-407a-a48d-ef65f3133dbc", "name": "network-vif-plugged", "status": "completed", "tag": "5263720a-56c1-460b-8d53-95927806ac6a"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:31.135791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-963e9544-7918-46ac-9755-cc070aff21c7 req-eb8f4ae6-35d0-4293-a5d5-30a4f39883e7 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.136287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-963e9544-7918-46ac-9755-cc070aff21c7 req-eb8f4ae6-35d0-4293-a5d5-30a4f39883e7 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:31.161003 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-963e9544-7918-46ac-9755-cc070aff21c7 req-eb8f4ae6-35d0-4293-a5d5-30a4f39883e7 service nova] Creating event network-vif-plugged:5263720a-56c1-460b-8d53-95927806ac6a for instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc on hv-cinder-84713 Jun 24 08:41:31.167188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-963e9544-7918-46ac-9755-cc070aff21c7 req-eb8f4ae6-35d0-4293-a5d5-30a4f39883e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057853 Jun 24 08:41:31.168706 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 61/117] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:31.315191 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:31.315823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:31.318960 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7219ba42-b960-4907-96a8-41ff37f9b5d6 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:31.320463 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7219ba42-b960-4907-96a8-41ff37f9b5d6 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:31.338307 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.338813 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:31.339786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.345038 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7219ba42-b960-4907-96a8-41ff37f9b5d6 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.345500 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7219ba42-b960-4907-96a8-41ff37f9b5d6 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:31.348175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:31.352929 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7219ba42-b960-4907-96a8-41ff37f9b5d6 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.353439 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7219ba42-b960-4907-96a8-41ff37f9b5d6 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:31.647556 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7219ba42-b960-4907-96a8-41ff37f9b5d6 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:31.660561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7219ba42-b960-4907-96a8-41ff37f9b5d6 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.354080 Jun 24 08:41:31.669933 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 62/118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:31 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:31.757101 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:31.766833 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:31.768501 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:31.770487 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7541cfa3-79a2-4344-81a8-313a5fbc522e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.463672 Jun 24 08:41:31.771700 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 57/119] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:31 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:31.787175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6cde603a-7436-48d1-9bb2-81c539ea0c8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:31.787991 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6cde603a-7436-48d1-9bb2-81c539ea0c8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:31.795202 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6cde603a-7436-48d1-9bb2-81c539ea0c8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.795656 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6cde603a-7436-48d1-9bb2-81c539ea0c8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:31.796418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6cde603a-7436-48d1-9bb2-81c539ea0c8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.797001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6cde603a-7436-48d1-9bb2-81c539ea0c8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:31.888703 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4dacd209-e144-444f-91ef-2e677371f0a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:31.889398 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4dacd209-e144-444f-91ef-2e677371f0a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:31.902807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4dacd209-e144-444f-91ef-2e677371f0a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.904511 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4dacd209-e144-444f-91ef-2e677371f0a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:31.907097 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4dacd209-e144-444f-91ef-2e677371f0a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:31.907760 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4dacd209-e144-444f-91ef-2e677371f0a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:32.104253 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6cde603a-7436-48d1-9bb2-81c539ea0c8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:32.121317 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6cde603a-7436-48d1-9bb2-81c539ea0c8a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.339228 Jun 24 08:41:32.124084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 63/120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:31 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:32.193946 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4dacd209-e144-444f-91ef-2e677371f0a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:32.203277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4dacd209-e144-444f-91ef-2e677371f0a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.317780 Jun 24 08:41:32.203871 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 58/121] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:31 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:32.678125 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8d50b6e2-3c02-4b72-ad31-ed45ac140005 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:32.678746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8d50b6e2-3c02-4b72-ad31-ed45ac140005 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:32.688917 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d50b6e2-3c02-4b72-ad31-ed45ac140005 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:32.689363 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d50b6e2-3c02-4b72-ad31-ed45ac140005 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:32.690344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d50b6e2-3c02-4b72-ad31-ed45ac140005 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:32.695652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d50b6e2-3c02-4b72-ad31-ed45ac140005 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:32.790016 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:32.791280 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:32.797919 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:32.798852 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:32.800089 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:32.800968 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:32.975831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8d50b6e2-3c02-4b72-ad31-ed45ac140005 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:32.985134 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8d50b6e2-3c02-4b72-ad31-ed45ac140005 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.310738 Jun 24 08:41:32.995428 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 64/122] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:32 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:33.082600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:33.096140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:33.098678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:33.100151 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5ce6c4b4-f949-4adc-a78c-ec282ae16c23 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.315483 Jun 24 08:41:33.111445 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 59/123] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:32 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:33.143204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-81969893-5228-4277-960c-d00cffde385c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:33.144235 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-81969893-5228-4277-960c-d00cffde385c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:33.151786 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81969893-5228-4277-960c-d00cffde385c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:33.152571 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81969893-5228-4277-960c-d00cffde385c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:33.153458 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81969893-5228-4277-960c-d00cffde385c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:33.154023 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81969893-5228-4277-960c-d00cffde385c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:33.204068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-3c2c5cd1-a263-4a13-a331-cbea51b5f7ef req-d106c886-b99f-4f9b-96b8-b1b188bdd821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6c82-2da5-46c9-8757-4fa70bfa79b1", "name": "network-vif-plugged", "status": "completed", "tag": "24b20858-8a37-47d6-98c3-e6bff8bd12c1"}, {"server_uuid": "02263624-79cc-4fbf-ad1d-8abe625c93e8", "name": "network-vif-plugged", "status": "completed", "tag": "19d07780-3de0-4b28-8969-232ca62ab3ff"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:33.230754 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3c2c5cd1-a263-4a13-a331-cbea51b5f7ef req-d106c886-b99f-4f9b-96b8-b1b188bdd821 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:33.234177 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3c2c5cd1-a263-4a13-a331-cbea51b5f7ef req-d106c886-b99f-4f9b-96b8-b1b188bdd821 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:33.257045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-3c2c5cd1-a263-4a13-a331-cbea51b5f7ef req-d106c886-b99f-4f9b-96b8-b1b188bdd821 service nova] Creating event network-vif-plugged:24b20858-8a37-47d6-98c3-e6bff8bd12c1 for instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 on hv-cinder-84713 Jun 24 08:41:33.264168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-3c2c5cd1-a263-4a13-a331-cbea51b5f7ef req-d106c886-b99f-4f9b-96b8-b1b188bdd821 service nova] Creating event network-vif-plugged:19d07780-3de0-4b28-8969-232ca62ab3ff for instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 on hv-cinder-84713 Jun 24 08:41:33.279814 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-3c2c5cd1-a263-4a13-a331-cbea51b5f7ef req-d106c886-b99f-4f9b-96b8-b1b188bdd821 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078705 Jun 24 08:41:33.280771 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 60/124] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:33.293488 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3a09c969-8014-4897-b246-c5f71d565d1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:33.296701 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3a09c969-8014-4897-b246-c5f71d565d1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:33.315077 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a09c969-8014-4897-b246-c5f71d565d1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:33.315595 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a09c969-8014-4897-b246-c5f71d565d1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:33.316604 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a09c969-8014-4897-b246-c5f71d565d1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:33.317277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a09c969-8014-4897-b246-c5f71d565d1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:33.405486 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-81969893-5228-4277-960c-d00cffde385c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:33.414622 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-81969893-5228-4277-960c-d00cffde385c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1362 microversion: 2.1 time: 0.276091 Jun 24 08:41:33.418045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 65/125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:33 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:33.593860 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3a09c969-8014-4897-b246-c5f71d565d1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:33.609332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3a09c969-8014-4897-b246-c5f71d565d1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.325338 Jun 24 08:41:33.610614 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 61/126] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:33 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:34.008391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-77428f32-0474-443c-9818-1d6061110505 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:34.009518 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-77428f32-0474-443c-9818-1d6061110505 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:34.024216 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-77428f32-0474-443c-9818-1d6061110505 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:34.025742 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-77428f32-0474-443c-9818-1d6061110505 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:34.025742 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-77428f32-0474-443c-9818-1d6061110505 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:34.025945 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-77428f32-0474-443c-9818-1d6061110505 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:34.121387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:34.122321 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:34.131694 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:34.131694 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:34.132108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:34.132542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:34.411278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-77428f32-0474-443c-9818-1d6061110505 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:34.419716 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-77428f32-0474-443c-9818-1d6061110505 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.419583 Jun 24 08:41:34.422832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:34.429278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 66/127] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:33 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:34.434088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:34.435385 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-446675431", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "networks": [{"uuid": "f4138681-b558-4fee-81a5-bb532db98280"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:34.436020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:34.440014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c914043e-e374-45c7-93aa-3714e1087204 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.321744 Jun 24 08:41:34.440014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 62/128] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:34 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:41:34.445642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-df10fed8-1d10-4525-aa4b-3202e6bb4f7a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:34.446813 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-df10fed8-1d10-4525-aa4b-3202e6bb4f7a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:34.463161 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df10fed8-1d10-4525-aa4b-3202e6bb4f7a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:34.463736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df10fed8-1d10-4525-aa4b-3202e6bb4f7a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:34.464697 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df10fed8-1d10-4525-aa4b-3202e6bb4f7a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:34.465283 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df10fed8-1d10-4525-aa4b-3202e6bb4f7a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:34.500896 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] validate_networks() for [('f4138681-b558-4fee-81a5-bb532db98280', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:41:34.722192 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-df10fed8-1d10-4525-aa4b-3202e6bb4f7a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:34.730484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-df10fed8-1d10-4525-aa4b-3202e6bb4f7a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1548 microversion: 2.1 time: 0.291058 Jun 24 08:41:34.731291 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 63/129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:34 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1548 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:34.737222 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9f5f56c6-cba2-4ec6-9480-bb6d416f71db tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:34.738687 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9f5f56c6-cba2-4ec6-9480-bb6d416f71db tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:34.748794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5f56c6-cba2-4ec6-9480-bb6d416f71db tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:34.751445 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5f56c6-cba2-4ec6-9480-bb6d416f71db tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:34.753008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5f56c6-cba2-4ec6-9480-bb6d416f71db tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:34.753008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5f56c6-cba2-4ec6-9480-bb6d416f71db tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:34.998401 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9f5f56c6-cba2-4ec6-9480-bb6d416f71db tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:35.011929 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9f5f56c6-cba2-4ec6-9480-bb6d416f71db tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.279243 Jun 24 08:41:35.013023 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 64/130] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:34 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:35.024349 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0bce70b5-658e-44e0-8e7f-b231fab2bf9b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:35.025107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0bce70b5-658e-44e0-8e7f-b231fab2bf9b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:35.033049 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0bce70b5-658e-44e0-8e7f-b231fab2bf9b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.034005 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0bce70b5-658e-44e0-8e7f-b231fab2bf9b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.034855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0bce70b5-658e-44e0-8e7f-b231fab2bf9b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.036036 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0bce70b5-658e-44e0-8e7f-b231fab2bf9b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.130791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:41:35.131805 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:41:35.132541 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:41:35.133657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:41:35.135073 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:41:35.158652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.159464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.160734 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.161331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.207716 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Getting quotas for project 91137dbd48fe4e6d986c350c8435bbab. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:41:35.220065 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Getting quotas for user 740d843e5abb439b954996aaf841ed63 and project 91137dbd48fe4e6d986c350c8435bbab. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:41:35.240896 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0bce70b5-658e-44e0-8e7f-b231fab2bf9b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226859 Jun 24 08:41:35.248578 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 65/131] 10.222.0.13 () {58 vars in 1274 bytes} [Fri Jun 24 08:41:35 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:35.252141 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:41:35.255270 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:41:35.313507 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-3cddd447-11b3-4813-99a1-8c9f2e7844d1 req-d3a9ed70-4d37-4901-9f1d-206b0c5c525c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16405cd6-0d3f-4ea7-9972-e8d1588ff058", "name": "network-vif-plugged", "status": "completed", "tag": "e99f3915-dc1e-4d3a-8acc-b64cbbda9e3b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:35.325220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-82ecebf3-1977-4c25-82df-14e457a016a1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893945 Jun 24 08:41:35.327502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3cddd447-11b3-4813-99a1-8c9f2e7844d1 req-d3a9ed70-4d37-4901-9f1d-206b0c5c525c service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.328072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 67/132] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:41:35.328558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3cddd447-11b3-4813-99a1-8c9f2e7844d1 req-d3a9ed70-4d37-4901-9f1d-206b0c5c525c service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.338855 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-18631b83-5307-42c7-bd48-3b17cddeb03b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:35.339709 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-18631b83-5307-42c7-bd48-3b17cddeb03b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:35.342186 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-3cddd447-11b3-4813-99a1-8c9f2e7844d1 req-d3a9ed70-4d37-4901-9f1d-206b0c5c525c service nova] Creating event network-vif-plugged:e99f3915-dc1e-4d3a-8acc-b64cbbda9e3b for instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 on hv-cinder-84713 Jun 24 08:41:35.357114 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-3cddd447-11b3-4813-99a1-8c9f2e7844d1 req-d3a9ed70-4d37-4901-9f1d-206b0c5c525c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041270 Jun 24 08:41:35.357114 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 66/133] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:35.448173 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6e3eff8b-05fa-47d0-bf48-1c2e78367963 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:35.448173 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6e3eff8b-05fa-47d0-bf48-1c2e78367963 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:35.477875 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e3eff8b-05fa-47d0-bf48-1c2e78367963 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.478802 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e3eff8b-05fa-47d0-bf48-1c2e78367963 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.480972 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e3eff8b-05fa-47d0-bf48-1c2e78367963 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.482168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e3eff8b-05fa-47d0-bf48-1c2e78367963 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.502464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-18631b83-5307-42c7-bd48-3b17cddeb03b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:35.512737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-18631b83-5307-42c7-bd48-3b17cddeb03b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1213 microversion: 2.1 time: 0.178157 Jun 24 08:41:35.513874 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 68/134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:35 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:35.526101 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:35.529225 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:35.539895 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.547158 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.551098 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.552628 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:36.127173 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6e3eff8b-05fa-47d0-bf48-1c2e78367963 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:36.135045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6e3eff8b-05fa-47d0-bf48-1c2e78367963 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.701699 Jun 24 08:41:36.135625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 67/135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:35 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:36.140051 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-115f71e2-b83d-434f-87ec-ec9eba77f3ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:36.142735 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-115f71e2-b83d-434f-87ec-ec9eba77f3ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:36.158847 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-115f71e2-b83d-434f-87ec-ec9eba77f3ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:36.159298 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-115f71e2-b83d-434f-87ec-ec9eba77f3ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:36.160769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-115f71e2-b83d-434f-87ec-ec9eba77f3ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:36.161348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-115f71e2-b83d-434f-87ec-ec9eba77f3ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:36.183035 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:36.267907 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:36.283553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:36.286961 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:36.288323 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-11e87c1d-c2e3-46e3-8a04-75524b8d4ccf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.773332 Jun 24 08:41:36.289086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 69/136] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:35 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:36.532805 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6784e771-22b9-4e52-9dd8-774c25ff8489 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:36.534004 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6784e771-22b9-4e52-9dd8-774c25ff8489 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:36.543814 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6784e771-22b9-4e52-9dd8-774c25ff8489 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:36.544650 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6784e771-22b9-4e52-9dd8-774c25ff8489 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:36.545619 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6784e771-22b9-4e52-9dd8-774c25ff8489 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:36.547222 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6784e771-22b9-4e52-9dd8-774c25ff8489 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:36.553140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-115f71e2-b83d-434f-87ec-ec9eba77f3ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:36.564059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-115f71e2-b83d-434f-87ec-ec9eba77f3ca tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.425757 Jun 24 08:41:36.564655 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 68/137] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:36 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:36.668776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6784e771-22b9-4e52-9dd8-774c25ff8489 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:36.681512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6784e771-22b9-4e52-9dd8-774c25ff8489 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1217 microversion: 2.1 time: 0.154491 Jun 24 08:41:36.691068 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 70/138] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:36 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:37.152115 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f0484a2a-1b9f-455b-8005-00a2b705d91b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:37.152731 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f0484a2a-1b9f-455b-8005-00a2b705d91b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:37.161511 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0484a2a-1b9f-455b-8005-00a2b705d91b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.163470 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0484a2a-1b9f-455b-8005-00a2b705d91b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.166499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0484a2a-1b9f-455b-8005-00a2b705d91b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.167117 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0484a2a-1b9f-455b-8005-00a2b705d91b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.291691 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-f11919b2-4a1b-4d48-9807-9176aceaf72f req-a0045dcc-069d-47af-8a6a-ced75fa7c97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5d35ce-c7be-407a-a48d-ef65f3133dbc", "tag": "5263720a-56c1-460b-8d53-95927806ac6a"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:37.306421 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f11919b2-4a1b-4d48-9807-9176aceaf72f req-a0045dcc-069d-47af-8a6a-ced75fa7c97b service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.306868 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f11919b2-4a1b-4d48-9807-9176aceaf72f req-a0045dcc-069d-47af-8a6a-ced75fa7c97b service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.332328 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-f11919b2-4a1b-4d48-9807-9176aceaf72f req-a0045dcc-069d-47af-8a6a-ced75fa7c97b service nova] Creating event network-changed:5263720a-56c1-460b-8d53-95927806ac6a for instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc on hv-cinder-84713 Jun 24 08:41:37.341854 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-f11919b2-4a1b-4d48-9807-9176aceaf72f req-a0045dcc-069d-47af-8a6a-ced75fa7c97b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053571 Jun 24 08:41:37.343289 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 71/139] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:37.361315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:37.362461 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:37.382874 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.384093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.385214 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.385942 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.401460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f0484a2a-1b9f-455b-8005-00a2b705d91b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:37.412142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f0484a2a-1b9f-455b-8005-00a2b705d91b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.264961 Jun 24 08:41:37.412898 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 69/140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:37 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:37.562843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:37.571747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:37.573511 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:37.574848 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a3d9e1ba-4e15-4243-8619-5b6a4f90da97 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1407 microversion: 2.20 time: 0.230379 Jun 24 08:41:37.575464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 72/141] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:37 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:37.589949 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-86a2f907-1813-43f4-94f4-7c6f08841204 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:37.591153 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-86a2f907-1813-43f4-94f4-7c6f08841204 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:37.597770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86a2f907-1813-43f4-94f4-7c6f08841204 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.598220 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86a2f907-1813-43f4-94f4-7c6f08841204 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.599002 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86a2f907-1813-43f4-94f4-7c6f08841204 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.599439 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86a2f907-1813-43f4-94f4-7c6f08841204 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.707253 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aaba610b-6bea-49bd-8da0-b8bbbcac270a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:37.707965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-aaba610b-6bea-49bd-8da0-b8bbbcac270a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:37.712617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:37.726333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aaba610b-6bea-49bd-8da0-b8bbbcac270a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.727807 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aaba610b-6bea-49bd-8da0-b8bbbcac270a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.728633 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aaba610b-6bea-49bd-8da0-b8bbbcac270a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:37.729931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aaba610b-6bea-49bd-8da0-b8bbbcac270a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:37.853241 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aaba610b-6bea-49bd-8da0-b8bbbcac270a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:37.864598 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aaba610b-6bea-49bd-8da0-b8bbbcac270a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1217 microversion: 2.1 time: 0.160447 Jun 24 08:41:37.865224 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 73/142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:37 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:37.883001 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-86a2f907-1813-43f4-94f4-7c6f08841204 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:37.892803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-86a2f907-1813-43f4-94f4-7c6f08841204 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.314686 Jun 24 08:41:37.893968 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 70/143] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:37 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:38.429663 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-eb6aed26-83d6-4d46-bc7b-0a71a39faaff tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:38.430398 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-eb6aed26-83d6-4d46-bc7b-0a71a39faaff tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:38.438400 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb6aed26-83d6-4d46-bc7b-0a71a39faaff tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:38.439235 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb6aed26-83d6-4d46-bc7b-0a71a39faaff tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:38.440171 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb6aed26-83d6-4d46-bc7b-0a71a39faaff tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:38.440762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eb6aed26-83d6-4d46-bc7b-0a71a39faaff tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:38.595066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:38.596717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:38.608981 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:38.609440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:38.610268 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:38.610704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:38.623946 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-eb6aed26-83d6-4d46-bc7b-0a71a39faaff tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:38.634059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-eb6aed26-83d6-4d46-bc7b-0a71a39faaff tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.209225 Jun 24 08:41:38.635498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 74/144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:38 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:38.820673 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:38.832927 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:38.835007 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:38.836625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-df464383-5d6e-4cc3-aee0-96d0b0420c4a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1597 microversion: 2.20 time: 0.246145 Jun 24 08:41:38.837468 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 71/145] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:38 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1597 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:38.859150 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-808c3b09-e785-4f8b-8a2a-ea77770a09ee tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:38.859942 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-808c3b09-e785-4f8b-8a2a-ea77770a09ee tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:38.867770 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-808c3b09-e785-4f8b-8a2a-ea77770a09ee tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:38.868239 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-808c3b09-e785-4f8b-8a2a-ea77770a09ee tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:38.869340 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-808c3b09-e785-4f8b-8a2a-ea77770a09ee tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:38.869901 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-808c3b09-e785-4f8b-8a2a-ea77770a09ee tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:38.887699 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2dee5b26-1b4f-4136-90a8-29a0e9326e31 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:38.888711 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2dee5b26-1b4f-4136-90a8-29a0e9326e31 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:38.904446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2dee5b26-1b4f-4136-90a8-29a0e9326e31 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:38.908708 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2dee5b26-1b4f-4136-90a8-29a0e9326e31 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:38.909569 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2dee5b26-1b4f-4136-90a8-29a0e9326e31 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:38.912551 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2dee5b26-1b4f-4136-90a8-29a0e9326e31 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:39.048976 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2dee5b26-1b4f-4136-90a8-29a0e9326e31 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:39.059664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2dee5b26-1b4f-4136-90a8-29a0e9326e31 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1217 microversion: 2.1 time: 0.180756 Jun 24 08:41:39.061513 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 72/146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:38 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:39.069546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f4a55d1c-e700-47ee-ac71-59fa962ac462 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:39.070577 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f4a55d1c-e700-47ee-ac71-59fa962ac462 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:39.071830 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-808c3b09-e785-4f8b-8a2a-ea77770a09ee tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.219187 Jun 24 08:41:39.072491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 75/147] 10.222.0.13 () {60 vars in 1315 bytes} [Fri Jun 24 08:41:38 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:41:39.091504 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f4a55d1c-e700-47ee-ac71-59fa962ac462 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:39.095275 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f4a55d1c-e700-47ee-ac71-59fa962ac462 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:39.096415 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f4a55d1c-e700-47ee-ac71-59fa962ac462 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:39.098637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f4a55d1c-e700-47ee-ac71-59fa962ac462 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:39.609214 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f4a55d1c-e700-47ee-ac71-59fa962ac462 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:39.622496 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f4a55d1c-e700-47ee-ac71-59fa962ac462 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.557280 Jun 24 08:41:39.624124 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 73/148] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:39 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:39.656935 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c63d7a91-cb65-4b1a-8623-8162a2185224 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:39.657933 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c63d7a91-cb65-4b1a-8623-8162a2185224 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:39.671572 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c63d7a91-cb65-4b1a-8623-8162a2185224 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:39.690262 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c63d7a91-cb65-4b1a-8623-8162a2185224 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:39.691782 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c63d7a91-cb65-4b1a-8623-8162a2185224 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:39.692224 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c63d7a91-cb65-4b1a-8623-8162a2185224 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:40.025654 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c63d7a91-cb65-4b1a-8623-8162a2185224 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:40.029671 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:40.038009 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c63d7a91-cb65-4b1a-8623-8162a2185224 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.390324 Jun 24 08:41:40.038833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 76/149] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:39 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:40.079196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fc45710d-cfd9-40b3-9248-33c23842cf5e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:40.080158 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fc45710d-cfd9-40b3-9248-33c23842cf5e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:40.087023 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc45710d-cfd9-40b3-9248-33c23842cf5e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:40.088016 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc45710d-cfd9-40b3-9248-33c23842cf5e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:40.089291 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc45710d-cfd9-40b3-9248-33c23842cf5e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:40.090461 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc45710d-cfd9-40b3-9248-33c23842cf5e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:40.170825 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fc45710d-cfd9-40b3-9248-33c23842cf5e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:40.179863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fc45710d-cfd9-40b3-9248-33c23842cf5e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1217 microversion: 2.1 time: 0.105444 Jun 24 08:41:40.180995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 74/150] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:40 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:40.640867 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c04cb6b4-e9b5-41c0-b637-b51add147932 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:40.641487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c04cb6b4-e9b5-41c0-b637-b51add147932 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:40.649050 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c04cb6b4-e9b5-41c0-b637-b51add147932 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:40.649499 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c04cb6b4-e9b5-41c0-b637-b51add147932 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:40.650296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c04cb6b4-e9b5-41c0-b637-b51add147932 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:40.651099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c04cb6b4-e9b5-41c0-b637-b51add147932 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:40.788162 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-0f83603b-5e98-4671-8132-ffc3669cd04a req-cebb7700-43fb-44dc-9cd9-9d7c6ae5c21d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ebf6c82-2da5-46c9-8757-4fa70bfa79b1", "tag": "24b20858-8a37-47d6-98c3-e6bff8bd12c1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:40.805484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-0f83603b-5e98-4671-8132-ffc3669cd04a req-cebb7700-43fb-44dc-9cd9-9d7c6ae5c21d service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:40.805974 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-0f83603b-5e98-4671-8132-ffc3669cd04a req-cebb7700-43fb-44dc-9cd9-9d7c6ae5c21d service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:40.830415 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-0f83603b-5e98-4671-8132-ffc3669cd04a req-cebb7700-43fb-44dc-9cd9-9d7c6ae5c21d service nova] Creating event network-changed:24b20858-8a37-47d6-98c3-e6bff8bd12c1 for instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 on hv-cinder-84713 Jun 24 08:41:40.850941 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-0f83603b-5e98-4671-8132-ffc3669cd04a req-cebb7700-43fb-44dc-9cd9-9d7c6ae5c21d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066943 Jun 24 08:41:40.851447 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 75/151] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:40.857804 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c04cb6b4-e9b5-41c0-b637-b51add147932 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:40.869539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c04cb6b4-e9b5-41c0-b637-b51add147932 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.231549 Jun 24 08:41:40.869539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 77/152] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:40 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:41.055951 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-84f21989-257c-48f8-8cb0-84fe7216307b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:41.056681 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-84f21989-257c-48f8-8cb0-84fe7216307b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:41.063040 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84f21989-257c-48f8-8cb0-84fe7216307b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:41.063493 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84f21989-257c-48f8-8cb0-84fe7216307b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:41.064267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84f21989-257c-48f8-8cb0-84fe7216307b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:41.064836 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84f21989-257c-48f8-8cb0-84fe7216307b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:41.196899 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7d811987-7e84-47ff-a763-5abf6cd38b4e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:41.197755 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7d811987-7e84-47ff-a763-5abf6cd38b4e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:41.205124 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d811987-7e84-47ff-a763-5abf6cd38b4e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:41.208298 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d811987-7e84-47ff-a763-5abf6cd38b4e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:41.209320 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d811987-7e84-47ff-a763-5abf6cd38b4e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:41.213041 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d811987-7e84-47ff-a763-5abf6cd38b4e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:41.263304 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-84f21989-257c-48f8-8cb0-84fe7216307b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:41.291880 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-84f21989-257c-48f8-8cb0-84fe7216307b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1315 microversion: 2.1 time: 0.238182 Jun 24 08:41:41.295344 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 76/153] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:41 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:41.344968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7d811987-7e84-47ff-a763-5abf6cd38b4e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:41.356088 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7d811987-7e84-47ff-a763-5abf6cd38b4e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1217 microversion: 2.1 time: 0.162877 Jun 24 08:41:41.357149 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 78/154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:41 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:41.888054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ecd864e-e32b-4b67-b7f0-2c42de7caadf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:41.888733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1ecd864e-e32b-4b67-b7f0-2c42de7caadf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:41.895517 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ecd864e-e32b-4b67-b7f0-2c42de7caadf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:41.896054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ecd864e-e32b-4b67-b7f0-2c42de7caadf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:41.896886 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ecd864e-e32b-4b67-b7f0-2c42de7caadf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:41.897381 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ecd864e-e32b-4b67-b7f0-2c42de7caadf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:42.039245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1ecd864e-e32b-4b67-b7f0-2c42de7caadf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:42.046749 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1ecd864e-e32b-4b67-b7f0-2c42de7caadf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.163108 Jun 24 08:41:42.047323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 77/155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:41 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:42.311459 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8a58d7d6-a307-4623-9ca8-590ea5ed4b96 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:42.312061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8a58d7d6-a307-4623-9ca8-590ea5ed4b96 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:42.318067 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8a58d7d6-a307-4623-9ca8-590ea5ed4b96 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:42.318502 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8a58d7d6-a307-4623-9ca8-590ea5ed4b96 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:42.319245 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8a58d7d6-a307-4623-9ca8-590ea5ed4b96 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:42.319673 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8a58d7d6-a307-4623-9ca8-590ea5ed4b96 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:42.374197 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c6f7e15c-3d4b-4fdd-a1be-dd290f59dcb1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:42.374964 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c6f7e15c-3d4b-4fdd-a1be-dd290f59dcb1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:42.381407 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c6f7e15c-3d4b-4fdd-a1be-dd290f59dcb1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:42.381892 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c6f7e15c-3d4b-4fdd-a1be-dd290f59dcb1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:42.382660 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c6f7e15c-3d4b-4fdd-a1be-dd290f59dcb1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:42.383090 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c6f7e15c-3d4b-4fdd-a1be-dd290f59dcb1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:42.464137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c6f7e15c-3d4b-4fdd-a1be-dd290f59dcb1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:42.472655 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c6f7e15c-3d4b-4fdd-a1be-dd290f59dcb1 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1217 microversion: 2.1 time: 0.101809 Jun 24 08:41:42.473533 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 78/156] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:42 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:42.506771 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8a58d7d6-a307-4623-9ca8-590ea5ed4b96 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:42.514552 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8a58d7d6-a307-4623-9ca8-590ea5ed4b96 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1502 microversion: 2.1 time: 0.206822 Jun 24 08:41:42.516852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 79/157] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:42 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:43.064376 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1b555d0f-4409-4f27-abd2-62f37cb3b0d1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:43.065136 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1b555d0f-4409-4f27-abd2-62f37cb3b0d1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:43.078993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b555d0f-4409-4f27-abd2-62f37cb3b0d1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:43.079452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b555d0f-4409-4f27-abd2-62f37cb3b0d1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:43.080297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b555d0f-4409-4f27-abd2-62f37cb3b0d1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:43.080935 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b555d0f-4409-4f27-abd2-62f37cb3b0d1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:43.239298 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1b555d0f-4409-4f27-abd2-62f37cb3b0d1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:43.246877 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1b555d0f-4409-4f27-abd2-62f37cb3b0d1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.186888 Jun 24 08:41:43.247446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 79/158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:43 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:43.490086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-60664d30-d812-4610-822b-131c9342916b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:43.491603 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-60664d30-d812-4610-822b-131c9342916b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:43.500179 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60664d30-d812-4610-822b-131c9342916b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:43.500918 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60664d30-d812-4610-822b-131c9342916b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:43.501843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60664d30-d812-4610-822b-131c9342916b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:43.502477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60664d30-d812-4610-822b-131c9342916b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:43.592967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-60664d30-d812-4610-822b-131c9342916b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:43.601411 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-60664d30-d812-4610-822b-131c9342916b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1209 microversion: 2.1 time: 0.115783 Jun 24 08:41:43.602013 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 80/159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:43 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:44.022613 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-40bd908a-d045-41b6-b9ca-85fc8feffd75 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da453697-9553-4b3f-9197-6673e32be143"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:44.023933 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-40bd908a-d045-41b6-b9ca-85fc8feffd75 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:44.030926 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40bd908a-d045-41b6-b9ca-85fc8feffd75 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:44.031371 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40bd908a-d045-41b6-b9ca-85fc8feffd75 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:44.032156 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40bd908a-d045-41b6-b9ca-85fc8feffd75 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:44.032595 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40bd908a-d045-41b6-b9ca-85fc8feffd75 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:44.266370 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4d704d31-1a01-4718-8609-2cfbcf6f3a27 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:44.266999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4d704d31-1a01-4718-8609-2cfbcf6f3a27 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:44.277855 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4d704d31-1a01-4718-8609-2cfbcf6f3a27 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:44.278680 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4d704d31-1a01-4718-8609-2cfbcf6f3a27 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:44.279475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4d704d31-1a01-4718-8609-2cfbcf6f3a27 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:44.280092 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4d704d31-1a01-4718-8609-2cfbcf6f3a27 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:44.583820 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4d704d31-1a01-4718-8609-2cfbcf6f3a27 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:44.591357 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4d704d31-1a01-4718-8609-2cfbcf6f3a27 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1321 microversion: 2.1 time: 0.328849 Jun 24 08:41:44.591943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 81/160] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:44 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:44.617762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0f1d7405-d624-4bf1-9cbc-f45526ca48f8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:44.618488 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0f1d7405-d624-4bf1-9cbc-f45526ca48f8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:44.624714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0f1d7405-d624-4bf1-9cbc-f45526ca48f8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:44.625159 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0f1d7405-d624-4bf1-9cbc-f45526ca48f8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:44.625983 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0f1d7405-d624-4bf1-9cbc-f45526ca48f8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:44.626446 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0f1d7405-d624-4bf1-9cbc-f45526ca48f8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:44.691537 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0f1d7405-d624-4bf1-9cbc-f45526ca48f8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:44.699319 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0f1d7405-d624-4bf1-9cbc-f45526ca48f8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1273 microversion: 2.1 time: 0.085384 Jun 24 08:41:44.699884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 82/161] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:44 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:45.184910 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-40bd908a-d045-41b6-b9ca-85fc8feffd75 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "POST /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.167891 Jun 24 08:41:45.185863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 80/162] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:41:44 2022] POST /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8/os-volume_attachments => generated 194 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:45.609622 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3748c420-7251-48b6-96ff-4e569d48004f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:45.610266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3748c420-7251-48b6-96ff-4e569d48004f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:45.612098 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:45.612818 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=8 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:45.623484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3748c420-7251-48b6-96ff-4e569d48004f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:45.623484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3748c420-7251-48b6-96ff-4e569d48004f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:45.623484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3748c420-7251-48b6-96ff-4e569d48004f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:45.623484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3748c420-7251-48b6-96ff-4e569d48004f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:45.719658 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b418d0df-0204-43a9-8423-52c45ebd5aff tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:45.720627 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b418d0df-0204-43a9-8423-52c45ebd5aff tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:45.727447 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b418d0df-0204-43a9-8423-52c45ebd5aff tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:45.728111 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b418d0df-0204-43a9-8423-52c45ebd5aff tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:45.728874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b418d0df-0204-43a9-8423-52c45ebd5aff tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:45.729304 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b418d0df-0204-43a9-8423-52c45ebd5aff tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:45.761195 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3748c420-7251-48b6-96ff-4e569d48004f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:45.780859 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3748c420-7251-48b6-96ff-4e569d48004f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1514 microversion: 2.1 time: 0.175856 Jun 24 08:41:45.781939 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 83/163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:45 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:45.799995 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c0bc716a-3c1e-4583-8cdd-f18530527f26 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:45.801138 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b418d0df-0204-43a9-8423-52c45ebd5aff tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:45.801337 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c0bc716a-3c1e-4583-8cdd-f18530527f26 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:45.809176 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c0bc716a-3c1e-4583-8cdd-f18530527f26 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:45.809620 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c0bc716a-3c1e-4583-8cdd-f18530527f26 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:45.810430 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b418d0df-0204-43a9-8423-52c45ebd5aff tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1271 microversion: 2.1 time: 0.095391 Jun 24 08:41:45.810736 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c0bc716a-3c1e-4583-8cdd-f18530527f26 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:45.811227 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 81/164] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:45 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:45.811578 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c0bc716a-3c1e-4583-8cdd-f18530527f26 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:45.844232 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-c0bc716a-3c1e-4583-8cdd-f18530527f26 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lazy-loading 'flavor' on Instance uuid 16405cd6-0d3f-4ea7-9972-e8d1588ff058 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:41:45.985210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c0bc716a-3c1e-4583-8cdd-f18530527f26 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058/action" status: 200 len: 32 microversion: 2.1 time: 0.189404 Jun 24 08:41:45.986225 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 84/165] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:41:45 2022] POST /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 08:41:45.996324 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f5d704e0-8bb4-4496-be46-5406d9bb9331 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:45.996959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f5d704e0-8bb4-4496-be46-5406d9bb9331 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:46.004477 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5d704e0-8bb4-4496-be46-5406d9bb9331 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:46.004993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5d704e0-8bb4-4496-be46-5406d9bb9331 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:46.005927 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5d704e0-8bb4-4496-be46-5406d9bb9331 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:46.006338 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5d704e0-8bb4-4496-be46-5406d9bb9331 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:46.259360 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f5d704e0-8bb4-4496-be46-5406d9bb9331 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:46.271883 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f5d704e0-8bb4-4496-be46-5406d9bb9331 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.279933 Jun 24 08:41:46.272848 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 82/166] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:45 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:46.828996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f610afe9-40f6-43bd-ad2a-af8622e1726b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:46.829702 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f610afe9-40f6-43bd-ad2a-af8622e1726b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:46.839883 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f610afe9-40f6-43bd-ad2a-af8622e1726b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:46.840328 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f610afe9-40f6-43bd-ad2a-af8622e1726b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:46.841097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f610afe9-40f6-43bd-ad2a-af8622e1726b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:46.841530 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f610afe9-40f6-43bd-ad2a-af8622e1726b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:47.178467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f610afe9-40f6-43bd-ad2a-af8622e1726b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:47.186500 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f610afe9-40f6-43bd-ad2a-af8622e1726b tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.361594 Jun 24 08:41:47.187309 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 85/167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:46 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:47.293944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-00088ac4-6600-480c-8a12-af0827fe4c49 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:47.294696 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-00088ac4-6600-480c-8a12-af0827fe4c49 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:47.311110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00088ac4-6600-480c-8a12-af0827fe4c49 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:47.311566 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00088ac4-6600-480c-8a12-af0827fe4c49 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:47.312398 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00088ac4-6600-480c-8a12-af0827fe4c49 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:47.312801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00088ac4-6600-480c-8a12-af0827fe4c49 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:47.668333 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-00088ac4-6600-480c-8a12-af0827fe4c49 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:47.683017 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-00088ac4-6600-480c-8a12-af0827fe4c49 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.393564 Jun 24 08:41:47.693436 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 83/168] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:47 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:48.070205 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-c2479fa6-f40f-45e6-b5e6-58655334e58a req-0e225cd4-2282-4b74-8f75-200213f4ac07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3fe588b-65ae-4734-93c5-9d9b21db688b", "tag": "1b472f9d-dba2-4d17-8a87-19cc1fe545c5"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:48.088544 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c2479fa6-f40f-45e6-b5e6-58655334e58a req-0e225cd4-2282-4b74-8f75-200213f4ac07 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.089129 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c2479fa6-f40f-45e6-b5e6-58655334e58a req-0e225cd4-2282-4b74-8f75-200213f4ac07 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.102559 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-c2479fa6-f40f-45e6-b5e6-58655334e58a req-0e225cd4-2282-4b74-8f75-200213f4ac07 service nova] Creating event network-changed:1b472f9d-dba2-4d17-8a87-19cc1fe545c5 for instance b3fe588b-65ae-4734-93c5-9d9b21db688b on hv-cinder-84713 Jun 24 08:41:48.108177 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-c2479fa6-f40f-45e6-b5e6-58655334e58a req-0e225cd4-2282-4b74-8f75-200213f4ac07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041564 Jun 24 08:41:48.108864 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 86/169] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:48.204735 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-77b15659-9dd1-44d1-9455-7402dcbca0a9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:48.205907 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-77b15659-9dd1-44d1-9455-7402dcbca0a9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:48.213727 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77b15659-9dd1-44d1-9455-7402dcbca0a9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.214245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77b15659-9dd1-44d1-9455-7402dcbca0a9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.215341 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77b15659-9dd1-44d1-9455-7402dcbca0a9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.215965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77b15659-9dd1-44d1-9455-7402dcbca0a9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.234613 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:48.492013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-77b15659-9dd1-44d1-9455-7402dcbca0a9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:48.500777 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-77b15659-9dd1-44d1-9455-7402dcbca0a9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.299866 Jun 24 08:41:48.501828 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 84/170] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:48 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:48.700881 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5141420a-0b98-43f1-8dab-6f8e660c3941 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:48.701582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5141420a-0b98-43f1-8dab-6f8e660c3941 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:48.708567 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5141420a-0b98-43f1-8dab-6f8e660c3941 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.709059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5141420a-0b98-43f1-8dab-6f8e660c3941 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.709862 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5141420a-0b98-43f1-8dab-6f8e660c3941 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.710300 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5141420a-0b98-43f1-8dab-6f8e660c3941 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.851064 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5141420a-0b98-43f1-8dab-6f8e660c3941 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:48.859560 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5141420a-0b98-43f1-8dab-6f8e660c3941 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.162584 Jun 24 08:41:48.866473 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 87/171] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:48 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:49.520750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8748b969-20a0-4184-af51-bd98df3de316 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:49.521431 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8748b969-20a0-4184-af51-bd98df3de316 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:49.528604 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8748b969-20a0-4184-af51-bd98df3de316 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:49.529183 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8748b969-20a0-4184-af51-bd98df3de316 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:49.530137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8748b969-20a0-4184-af51-bd98df3de316 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:49.530645 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8748b969-20a0-4184-af51-bd98df3de316 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:49.676817 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8748b969-20a0-4184-af51-bd98df3de316 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:49.685187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8748b969-20a0-4184-af51-bd98df3de316 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.169009 Jun 24 08:41:49.686029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 85/172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:49 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:49.879543 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-274bd241-1ffd-4125-a57b-16d6133636bc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:49.880968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-274bd241-1ffd-4125-a57b-16d6133636bc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:49.887635 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-274bd241-1ffd-4125-a57b-16d6133636bc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:49.888456 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-274bd241-1ffd-4125-a57b-16d6133636bc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:49.889876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-274bd241-1ffd-4125-a57b-16d6133636bc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:49.890687 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-274bd241-1ffd-4125-a57b-16d6133636bc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:50.132588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-274bd241-1ffd-4125-a57b-16d6133636bc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:50.140493 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-274bd241-1ffd-4125-a57b-16d6133636bc tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.266371 Jun 24 08:41:50.141075 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 88/173] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:49 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:50.704140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f676ee38-bab8-409f-83c6-44d8a0df2ff2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:50.704756 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f676ee38-bab8-409f-83c6-44d8a0df2ff2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:50.711584 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f676ee38-bab8-409f-83c6-44d8a0df2ff2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:50.712061 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f676ee38-bab8-409f-83c6-44d8a0df2ff2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:50.712831 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f676ee38-bab8-409f-83c6-44d8a0df2ff2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:50.713263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f676ee38-bab8-409f-83c6-44d8a0df2ff2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:50.849422 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f676ee38-bab8-409f-83c6-44d8a0df2ff2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:50.856962 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f676ee38-bab8-409f-83c6-44d8a0df2ff2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.157116 Jun 24 08:41:50.857530 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 86/174] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:50 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:51.156579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6147bbeb-0526-4835-aff1-86eb9b28d7a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:51.157196 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6147bbeb-0526-4835-aff1-86eb9b28d7a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:51.164123 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6147bbeb-0526-4835-aff1-86eb9b28d7a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:51.164570 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6147bbeb-0526-4835-aff1-86eb9b28d7a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:51.165447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6147bbeb-0526-4835-aff1-86eb9b28d7a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:51.165921 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6147bbeb-0526-4835-aff1-86eb9b28d7a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:51.337402 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6147bbeb-0526-4835-aff1-86eb9b28d7a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:51.345012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6147bbeb-0526-4835-aff1-86eb9b28d7a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.192260 Jun 24 08:41:51.345589 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 89/175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:51 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:51.874719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a73c4f7a-4aa6-4cbd-83b6-217bde0477ec tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:51.875324 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a73c4f7a-4aa6-4cbd-83b6-217bde0477ec tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:51.881821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a73c4f7a-4aa6-4cbd-83b6-217bde0477ec tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:51.882265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a73c4f7a-4aa6-4cbd-83b6-217bde0477ec tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:51.883014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a73c4f7a-4aa6-4cbd-83b6-217bde0477ec tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:51.883442 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a73c4f7a-4aa6-4cbd-83b6-217bde0477ec tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:52.019646 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a73c4f7a-4aa6-4cbd-83b6-217bde0477ec tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:52.028364 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a73c4f7a-4aa6-4cbd-83b6-217bde0477ec tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.157647 Jun 24 08:41:52.028950 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 87/176] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:51 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:52.365545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e5d70e42-2d70-4216-a09e-c671e53b0bf4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:52.365545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e5d70e42-2d70-4216-a09e-c671e53b0bf4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:52.370112 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e5d70e42-2d70-4216-a09e-c671e53b0bf4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:52.370553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e5d70e42-2d70-4216-a09e-c671e53b0bf4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:52.371317 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e5d70e42-2d70-4216-a09e-c671e53b0bf4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:52.371743 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e5d70e42-2d70-4216-a09e-c671e53b0bf4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:52.515554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e5d70e42-2d70-4216-a09e-c671e53b0bf4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:52.525422 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e5d70e42-2d70-4216-a09e-c671e53b0bf4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.165864 Jun 24 08:41:52.526037 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 90/177] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:52 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:53.046010 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-962bc560-3c78-4461-b1b9-9d9125c678f0 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:53.046619 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-962bc560-3c78-4461-b1b9-9d9125c678f0 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:53.048945 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=87 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:53.054781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-962bc560-3c78-4461-b1b9-9d9125c678f0 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:53.055227 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-962bc560-3c78-4461-b1b9-9d9125c678f0 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:53.055993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-962bc560-3c78-4461-b1b9-9d9125c678f0 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:53.056425 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-962bc560-3c78-4461-b1b9-9d9125c678f0 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:53.196109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-962bc560-3c78-4461-b1b9-9d9125c678f0 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:53.203684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-962bc560-3c78-4461-b1b9-9d9125c678f0 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.161546 Jun 24 08:41:53.204263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 88/178] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:53 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:53.542799 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2b4c0fa9-8857-4f0c-917b-33bcd5aa69df tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:53.543575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2b4c0fa9-8857-4f0c-917b-33bcd5aa69df tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:53.551395 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2b4c0fa9-8857-4f0c-917b-33bcd5aa69df tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:53.551395 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2b4c0fa9-8857-4f0c-917b-33bcd5aa69df tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:53.552323 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2b4c0fa9-8857-4f0c-917b-33bcd5aa69df tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:53.552822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2b4c0fa9-8857-4f0c-917b-33bcd5aa69df tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:53.695991 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2b4c0fa9-8857-4f0c-917b-33bcd5aa69df tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:53.705047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2b4c0fa9-8857-4f0c-917b-33bcd5aa69df tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.166162 Jun 24 08:41:53.705629 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 91/179] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:53 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:54.221943 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c105a69-d06f-492e-868c-eb311e2d0dfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:54.221943 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2c105a69-d06f-492e-868c-eb311e2d0dfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:54.229532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c105a69-d06f-492e-868c-eb311e2d0dfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:54.230008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c105a69-d06f-492e-868c-eb311e2d0dfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:54.230840 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c105a69-d06f-492e-868c-eb311e2d0dfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:54.231283 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c105a69-d06f-492e-868c-eb311e2d0dfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:54.388908 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2c105a69-d06f-492e-868c-eb311e2d0dfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:54.400613 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2c105a69-d06f-492e-868c-eb311e2d0dfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.184645 Jun 24 08:41:54.401164 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 89/180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:54 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:54.727804 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8c16dbbc-59c2-46cf-aba9-58444762835b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:54.728457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8c16dbbc-59c2-46cf-aba9-58444762835b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:54.736346 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c16dbbc-59c2-46cf-aba9-58444762835b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:54.736871 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c16dbbc-59c2-46cf-aba9-58444762835b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:54.738306 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c16dbbc-59c2-46cf-aba9-58444762835b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:54.738850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c16dbbc-59c2-46cf-aba9-58444762835b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:54.744272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:55.181008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8c16dbbc-59c2-46cf-aba9-58444762835b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:55.191165 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8c16dbbc-59c2-46cf-aba9-58444762835b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.468161 Jun 24 08:41:55.191796 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 92/181] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:54 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:55.418390 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2034093b-9581-46a2-b0d8-efc91fcc8615 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:55.419005 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2034093b-9581-46a2-b0d8-efc91fcc8615 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:55.428496 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2034093b-9581-46a2-b0d8-efc91fcc8615 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:55.428944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2034093b-9581-46a2-b0d8-efc91fcc8615 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:55.429781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2034093b-9581-46a2-b0d8-efc91fcc8615 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:55.430217 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2034093b-9581-46a2-b0d8-efc91fcc8615 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:55.637345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2034093b-9581-46a2-b0d8-efc91fcc8615 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:55.646935 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2034093b-9581-46a2-b0d8-efc91fcc8615 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.232970 Jun 24 08:41:55.648006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 90/182] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:55 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:56.210315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-72de3bfb-bd8e-4931-96b2-eb67f5ca00a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:56.211633 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-72de3bfb-bd8e-4931-96b2-eb67f5ca00a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:56.220521 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72de3bfb-bd8e-4931-96b2-eb67f5ca00a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.221249 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72de3bfb-bd8e-4931-96b2-eb67f5ca00a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.224102 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72de3bfb-bd8e-4931-96b2-eb67f5ca00a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.224697 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72de3bfb-bd8e-4931-96b2-eb67f5ca00a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.394516 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-14d3e023-d33f-4e55-af48-2d83f5b2764f req-5d5c21c9-8d8f-4561-8527-e145d90f7e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3fe588b-65ae-4734-93c5-9d9b21db688b", "name": "network-vif-plugged", "status": "completed", "tag": "1b472f9d-dba2-4d17-8a87-19cc1fe545c5"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:56.403834 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-72de3bfb-bd8e-4931-96b2-eb67f5ca00a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:56.413383 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-14d3e023-d33f-4e55-af48-2d83f5b2764f req-5d5c21c9-8d8f-4561-8527-e145d90f7e45 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.413882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-14d3e023-d33f-4e55-af48-2d83f5b2764f req-5d5c21c9-8d8f-4561-8527-e145d90f7e45 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.416378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-72de3bfb-bd8e-4931-96b2-eb67f5ca00a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.211522 Jun 24 08:41:56.417166 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 93/183] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:56 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:56.433583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-14d3e023-d33f-4e55-af48-2d83f5b2764f req-5d5c21c9-8d8f-4561-8527-e145d90f7e45 service nova] Creating event network-vif-plugged:1b472f9d-dba2-4d17-8a87-19cc1fe545c5 for instance b3fe588b-65ae-4734-93c5-9d9b21db688b on hv-cinder-84713 Jun 24 08:41:56.439041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-14d3e023-d33f-4e55-af48-2d83f5b2764f req-5d5c21c9-8d8f-4561-8527-e145d90f7e45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048285 Jun 24 08:41:56.439712 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 91/184] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:56.665980 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c8731271-effb-4edd-b1aa-50c46ac83154 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:56.666597 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c8731271-effb-4edd-b1aa-50c46ac83154 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:56.674104 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8731271-effb-4edd-b1aa-50c46ac83154 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.674548 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8731271-effb-4edd-b1aa-50c46ac83154 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.677979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8731271-effb-4edd-b1aa-50c46ac83154 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.678634 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8731271-effb-4edd-b1aa-50c46ac83154 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.896480 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c8731271-effb-4edd-b1aa-50c46ac83154 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:56.905529 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c8731271-effb-4edd-b1aa-50c46ac83154 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.245978 Jun 24 08:41:56.914029 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 94/185] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:56 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:57.033675 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e2de022e-094e-474f-bc22-f6b1a3e55a46 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:57.038298 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e2de022e-094e-474f-bc22-f6b1a3e55a46 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:57.046531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2de022e-094e-474f-bc22-f6b1a3e55a46 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.047155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2de022e-094e-474f-bc22-f6b1a3e55a46 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.048063 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2de022e-094e-474f-bc22-f6b1a3e55a46 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.048756 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2de022e-094e-474f-bc22-f6b1a3e55a46 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.077665 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e2de022e-094e-474f-bc22-f6b1a3e55a46 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:41:57.203632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e2de022e-094e-474f-bc22-f6b1a3e55a46 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 204 len: 0 microversion: 2.1 time: 0.173722 Jun 24 08:41:57.209902 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 92/186] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:41:57 2022] DELETE /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:41:57.215027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8547b117-ef14-42ea-8fa6-e81ffb89a8f9 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:57.215514 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8547b117-ef14-42ea-8fa6-e81ffb89a8f9 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:57.223092 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8547b117-ef14-42ea-8fa6-e81ffb89a8f9 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.223934 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8547b117-ef14-42ea-8fa6-e81ffb89a8f9 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.225237 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8547b117-ef14-42ea-8fa6-e81ffb89a8f9 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.226009 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8547b117-ef14-42ea-8fa6-e81ffb89a8f9 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.436536 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6c9bbe0a-dd07-43d3-b55c-1db4020d5704 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:57.438213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6c9bbe0a-dd07-43d3-b55c-1db4020d5704 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:57.444384 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8547b117-ef14-42ea-8fa6-e81ffb89a8f9 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:57.459029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c9bbe0a-dd07-43d3-b55c-1db4020d5704 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.460963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c9bbe0a-dd07-43d3-b55c-1db4020d5704 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.462836 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8547b117-ef14-42ea-8fa6-e81ffb89a8f9 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1554 microversion: 2.1 time: 0.251894 Jun 24 08:41:57.463567 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c9bbe0a-dd07-43d3-b55c-1db4020d5704 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.464269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c9bbe0a-dd07-43d3-b55c-1db4020d5704 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.465109 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 95/187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:57 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:57.620315 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6c9bbe0a-dd07-43d3-b55c-1db4020d5704 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:57.629894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6c9bbe0a-dd07-43d3-b55c-1db4020d5704 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.199212 Jun 24 08:41:57.630452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 93/188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:57 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:57.923066 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d6695f92-01ac-485c-9f81-7f20344f7d40 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:57.923831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d6695f92-01ac-485c-9f81-7f20344f7d40 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:57.931240 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6695f92-01ac-485c-9f81-7f20344f7d40 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.931754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6695f92-01ac-485c-9f81-7f20344f7d40 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.932528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6695f92-01ac-485c-9f81-7f20344f7d40 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.932953 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6695f92-01ac-485c-9f81-7f20344f7d40 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.084004 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d6695f92-01ac-485c-9f81-7f20344f7d40 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:58.092659 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d6695f92-01ac-485c-9f81-7f20344f7d40 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.173596 Jun 24 08:41:58.093234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 96/189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:57 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:58.482446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f5e99d1e-8083-4129-9510-a0dd83d372e1 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:58.483160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f5e99d1e-8083-4129-9510-a0dd83d372e1 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:58.489804 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5e99d1e-8083-4129-9510-a0dd83d372e1 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.490355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5e99d1e-8083-4129-9510-a0dd83d372e1 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.491199 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5e99d1e-8083-4129-9510-a0dd83d372e1 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.491702 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5e99d1e-8083-4129-9510-a0dd83d372e1 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.648401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4a9442c7-3bfd-41b2-92c4-6e69a338e5bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:58.649181 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4a9442c7-3bfd-41b2-92c4-6e69a338e5bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:58.655793 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a9442c7-3bfd-41b2-92c4-6e69a338e5bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.656250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a9442c7-3bfd-41b2-92c4-6e69a338e5bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.657024 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a9442c7-3bfd-41b2-92c4-6e69a338e5bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.657664 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a9442c7-3bfd-41b2-92c4-6e69a338e5bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.661871 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f5e99d1e-8083-4129-9510-a0dd83d372e1 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:58.670594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f5e99d1e-8083-4129-9510-a0dd83d372e1 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1554 microversion: 2.1 time: 0.191880 Jun 24 08:41:58.671303 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 94/190] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:58 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:58.821751 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4a9442c7-3bfd-41b2-92c4-6e69a338e5bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:58.832720 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4a9442c7-3bfd-41b2-92c4-6e69a338e5bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.188099 Jun 24 08:41:58.842763 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 97/191] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:58 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:59.109272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5ae1e515-1517-4763-a745-b4e94b9f253e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:59.109922 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5ae1e515-1517-4763-a745-b4e94b9f253e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:59.118355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ae1e515-1517-4763-a745-b4e94b9f253e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.118806 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ae1e515-1517-4763-a745-b4e94b9f253e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.119586 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ae1e515-1517-4763-a745-b4e94b9f253e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.120030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ae1e515-1517-4763-a745-b4e94b9f253e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.268971 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5ae1e515-1517-4763-a745-b4e94b9f253e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:59.276660 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5ae1e515-1517-4763-a745-b4e94b9f253e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.171250 Jun 24 08:41:59.277242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 95/192] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:59 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:59.689528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c6d78e57-f40a-4532-aef7-38459b0d3572 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:59.690204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c6d78e57-f40a-4532-aef7-38459b0d3572 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:59.697348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6d78e57-f40a-4532-aef7-38459b0d3572 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.697791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6d78e57-f40a-4532-aef7-38459b0d3572 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.698546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6d78e57-f40a-4532-aef7-38459b0d3572 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.698985 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6d78e57-f40a-4532-aef7-38459b0d3572 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.840321 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c6d78e57-f40a-4532-aef7-38459b0d3572 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:59.849232 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c6d78e57-f40a-4532-aef7-38459b0d3572 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1554 microversion: 2.1 time: 0.163517 Jun 24 08:41:59.849958 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 98/193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:59 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:59.850473 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-60a24315-9aff-4daa-bba1-0f0dc66ead6a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:59.851094 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-60a24315-9aff-4daa-bba1-0f0dc66ead6a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:59.865025 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60a24315-9aff-4daa-bba1-0f0dc66ead6a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.865477 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60a24315-9aff-4daa-bba1-0f0dc66ead6a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.866331 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60a24315-9aff-4daa-bba1-0f0dc66ead6a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.866768 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60a24315-9aff-4daa-bba1-0f0dc66ead6a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.022631 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-60a24315-9aff-4daa-bba1-0f0dc66ead6a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:00.032833 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-60a24315-9aff-4daa-bba1-0f0dc66ead6a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.186902 Jun 24 08:42:00.033662 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 96/194] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:59 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:00.293998 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-52a26f6c-efb8-49d4-9728-fe266c06e832 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:00.294630 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-52a26f6c-efb8-49d4-9728-fe266c06e832 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:00.303942 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52a26f6c-efb8-49d4-9728-fe266c06e832 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.304647 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52a26f6c-efb8-49d4-9728-fe266c06e832 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.305768 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52a26f6c-efb8-49d4-9728-fe266c06e832 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.306234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52a26f6c-efb8-49d4-9728-fe266c06e832 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.463391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-52a26f6c-efb8-49d4-9728-fe266c06e832 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:00.476028 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-52a26f6c-efb8-49d4-9728-fe266c06e832 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.183238 Jun 24 08:42:00.476028 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 99/195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:00 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:00.867514 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f16dc933-fec0-46ff-9a19-5436b5798798 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:00.868141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f16dc933-fec0-46ff-9a19-5436b5798798 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:00.875773 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f16dc933-fec0-46ff-9a19-5436b5798798 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.876214 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f16dc933-fec0-46ff-9a19-5436b5798798 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.876985 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f16dc933-fec0-46ff-9a19-5436b5798798 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.877429 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f16dc933-fec0-46ff-9a19-5436b5798798 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.050670 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f1736631-c9e7-457c-9fb9-95091b21ded8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:01.052641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f1736631-c9e7-457c-9fb9-95091b21ded8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:01.059365 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1736631-c9e7-457c-9fb9-95091b21ded8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.059822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1736631-c9e7-457c-9fb9-95091b21ded8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.060667 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1736631-c9e7-457c-9fb9-95091b21ded8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.061265 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1736631-c9e7-457c-9fb9-95091b21ded8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.078967 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f16dc933-fec0-46ff-9a19-5436b5798798 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:01.093289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f16dc933-fec0-46ff-9a19-5436b5798798 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1554 microversion: 2.1 time: 0.229428 Jun 24 08:42:01.094830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 97/196] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:00 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:01.216782 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f1736631-c9e7-457c-9fb9-95091b21ded8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:01.224597 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f1736631-c9e7-457c-9fb9-95091b21ded8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.177663 Jun 24 08:42:01.225480 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 100/197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:01 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:01.500744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-12b1976b-97f6-48e8-8adc-bd668280fdef tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:01.501451 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-12b1976b-97f6-48e8-8adc-bd668280fdef tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:01.509059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12b1976b-97f6-48e8-8adc-bd668280fdef tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.509495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12b1976b-97f6-48e8-8adc-bd668280fdef tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.510356 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12b1976b-97f6-48e8-8adc-bd668280fdef tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.510785 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12b1976b-97f6-48e8-8adc-bd668280fdef tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.648979 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-12b1976b-97f6-48e8-8adc-bd668280fdef tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:01.659985 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-12b1976b-97f6-48e8-8adc-bd668280fdef tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.172921 Jun 24 08:42:01.660794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 98/198] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:01 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:02.111107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e57bdc0d-9f4c-47b1-9093-b403a3c6c0fc tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:02.111764 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e57bdc0d-9f4c-47b1-9093-b403a3c6c0fc tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:02.118759 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e57bdc0d-9f4c-47b1-9093-b403a3c6c0fc tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.119211 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e57bdc0d-9f4c-47b1-9093-b403a3c6c0fc tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.120093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e57bdc0d-9f4c-47b1-9093-b403a3c6c0fc tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.120546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e57bdc0d-9f4c-47b1-9093-b403a3c6c0fc tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.245513 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5a8f6f1c-3d57-48df-a084-206e9ec1a424 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:02.246318 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5a8f6f1c-3d57-48df-a084-206e9ec1a424 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:02.254736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a8f6f1c-3d57-48df-a084-206e9ec1a424 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.255606 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a8f6f1c-3d57-48df-a084-206e9ec1a424 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.256618 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a8f6f1c-3d57-48df-a084-206e9ec1a424 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.257198 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a8f6f1c-3d57-48df-a084-206e9ec1a424 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.266434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e57bdc0d-9f4c-47b1-9093-b403a3c6c0fc tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:02.276236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e57bdc0d-9f4c-47b1-9093-b403a3c6c0fc tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1554 microversion: 2.1 time: 0.168833 Jun 24 08:42:02.276817 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 101/199] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:02 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:02.405190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5a8f6f1c-3d57-48df-a084-206e9ec1a424 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:02.413329 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5a8f6f1c-3d57-48df-a084-206e9ec1a424 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.172982 Jun 24 08:42:02.413989 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 99/200] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:02 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:02.677415 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f28c5b8a-a4b5-417c-a3e1-26da0943df71 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:02.678079 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f28c5b8a-a4b5-417c-a3e1-26da0943df71 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:02.684104 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f28c5b8a-a4b5-417c-a3e1-26da0943df71 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.684566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f28c5b8a-a4b5-417c-a3e1-26da0943df71 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.685313 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f28c5b8a-a4b5-417c-a3e1-26da0943df71 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.685771 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f28c5b8a-a4b5-417c-a3e1-26da0943df71 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.824015 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f28c5b8a-a4b5-417c-a3e1-26da0943df71 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:02.832436 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f28c5b8a-a4b5-417c-a3e1-26da0943df71 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1313 microversion: 2.1 time: 0.159417 Jun 24 08:42:02.833016 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 102/201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:02 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:03.294553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-359e2629-984c-4e3d-8a3f-eb79f99db969 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:03.295290 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-359e2629-984c-4e3d-8a3f-eb79f99db969 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:03.302068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-359e2629-984c-4e3d-8a3f-eb79f99db969 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.302505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-359e2629-984c-4e3d-8a3f-eb79f99db969 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.303418 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-359e2629-984c-4e3d-8a3f-eb79f99db969 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.303861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-359e2629-984c-4e3d-8a3f-eb79f99db969 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.308283 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:03.431048 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d1710a6f-d94d-4b44-9366-6f68995d9028 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:03.431656 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d1710a6f-d94d-4b44-9366-6f68995d9028 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:03.438495 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d1710a6f-d94d-4b44-9366-6f68995d9028 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.439215 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d1710a6f-d94d-4b44-9366-6f68995d9028 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.440017 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d1710a6f-d94d-4b44-9366-6f68995d9028 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.441288 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d1710a6f-d94d-4b44-9366-6f68995d9028 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.472401 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-359e2629-984c-4e3d-8a3f-eb79f99db969 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:03.481352 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-359e2629-984c-4e3d-8a3f-eb79f99db969 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1554 microversion: 2.1 time: 0.190887 Jun 24 08:42:03.482100 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 100/202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:03 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:03.615061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d1710a6f-d94d-4b44-9366-6f68995d9028 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:03.622519 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d1710a6f-d94d-4b44-9366-6f68995d9028 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.195306 Jun 24 08:42:03.623271 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 103/203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:03 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:03.849868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-09a278bb-371c-4297-86de-c6f74c343caa tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:03.850475 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-09a278bb-371c-4297-86de-c6f74c343caa tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:03.856456 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09a278bb-371c-4297-86de-c6f74c343caa tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.856891 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09a278bb-371c-4297-86de-c6f74c343caa tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.857642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09a278bb-371c-4297-86de-c6f74c343caa tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.858095 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09a278bb-371c-4297-86de-c6f74c343caa tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.987104 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-09a278bb-371c-4297-86de-c6f74c343caa tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:03.994607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-09a278bb-371c-4297-86de-c6f74c343caa tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1498 microversion: 2.1 time: 0.149416 Jun 24 08:42:03.995293 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 101/204] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:03 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:04.499643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-23463588-3a93-4783-89b1-fc4bee844d6e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:04.500194 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-23463588-3a93-4783-89b1-fc4bee844d6e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:04.506884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23463588-3a93-4783-89b1-fc4bee844d6e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:04.507339 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23463588-3a93-4783-89b1-fc4bee844d6e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:04.508122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23463588-3a93-4783-89b1-fc4bee844d6e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:04.508555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23463588-3a93-4783-89b1-fc4bee844d6e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:04.651063 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a1f49ad5-68ea-4844-88d8-56f9adf7c8a0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:04.651923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a1f49ad5-68ea-4844-88d8-56f9adf7c8a0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:04.661121 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1f49ad5-68ea-4844-88d8-56f9adf7c8a0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:04.661728 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1f49ad5-68ea-4844-88d8-56f9adf7c8a0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:04.662695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1f49ad5-68ea-4844-88d8-56f9adf7c8a0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:04.663279 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1f49ad5-68ea-4844-88d8-56f9adf7c8a0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:04.811404 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-23463588-3a93-4783-89b1-fc4bee844d6e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:04.819740 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-23463588-3a93-4783-89b1-fc4bee844d6e tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1554 microversion: 2.1 time: 0.324255 Jun 24 08:42:04.820350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 104/205] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:04 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1554 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:04.933385 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a1f49ad5-68ea-4844-88d8-56f9adf7c8a0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:04.941728 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a1f49ad5-68ea-4844-88d8-56f9adf7c8a0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.305213 Jun 24 08:42:04.942318 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 102/206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:04 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:05.180152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-88ed52eb-dec0-471b-9698-a2e28b4ab07e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:05.180650 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-88ed52eb-dec0-471b-9698-a2e28b4ab07e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:05.197415 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88ed52eb-dec0-471b-9698-a2e28b4ab07e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.198206 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88ed52eb-dec0-471b-9698-a2e28b4ab07e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.199189 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88ed52eb-dec0-471b-9698-a2e28b4ab07e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.199810 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88ed52eb-dec0-471b-9698-a2e28b4ab07e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.227950 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-6c693696-473f-46da-a3bc-b416f6a5585c req-2844482b-908f-4288-9bd2-90326de72341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02263624-79cc-4fbf-ad1d-8abe625c93e8", "name": "network-vif-deleted", "tag": "19d07780-3de0-4b28-8969-232ca62ab3ff"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:05.238629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-6c693696-473f-46da-a3bc-b416f6a5585c req-2844482b-908f-4288-9bd2-90326de72341 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.239081 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-6c693696-473f-46da-a3bc-b416f6a5585c req-2844482b-908f-4288-9bd2-90326de72341 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.243538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-88ed52eb-dec0-471b-9698-a2e28b4ab07e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:42:05.255194 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-6c693696-473f-46da-a3bc-b416f6a5585c req-2844482b-908f-4288-9bd2-90326de72341 service nova] Creating event network-vif-deleted:19d07780-3de0-4b28-8969-232ca62ab3ff for instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 on hv-cinder-84713 Jun 24 08:42:05.261576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-6c693696-473f-46da-a3bc-b416f6a5585c req-2844482b-908f-4288-9bd2-90326de72341 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036283 Jun 24 08:42:05.261576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 103/207] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:05.374811 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-88ed52eb-dec0-471b-9698-a2e28b4ab07e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 204 len: 0 microversion: 2.1 time: 0.198273 Jun 24 08:42:05.376366 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 105/208] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:42:05 2022] DELETE /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:42:05.387145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-44d62c90-9445-4b64-a39d-42a31fa05521 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:05.387851 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-44d62c90-9445-4b64-a39d-42a31fa05521 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:05.397226 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44d62c90-9445-4b64-a39d-42a31fa05521 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.397667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44d62c90-9445-4b64-a39d-42a31fa05521 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.398671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44d62c90-9445-4b64-a39d-42a31fa05521 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.399258 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44d62c90-9445-4b64-a39d-42a31fa05521 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.545730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-44d62c90-9445-4b64-a39d-42a31fa05521 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:05.553450 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-44d62c90-9445-4b64-a39d-42a31fa05521 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1504 microversion: 2.1 time: 0.171085 Jun 24 08:42:05.554065 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 104/209] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:05 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:05.839182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9eb90b2f-7542-42c9-a6d0-3e7fbd1a8b2b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:05.839884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9eb90b2f-7542-42c9-a6d0-3e7fbd1a8b2b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:05.845904 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9eb90b2f-7542-42c9-a6d0-3e7fbd1a8b2b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.846347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9eb90b2f-7542-42c9-a6d0-3e7fbd1a8b2b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.847102 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9eb90b2f-7542-42c9-a6d0-3e7fbd1a8b2b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.847530 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9eb90b2f-7542-42c9-a6d0-3e7fbd1a8b2b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.920741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9eb90b2f-7542-42c9-a6d0-3e7fbd1a8b2b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:05.929281 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9eb90b2f-7542-42c9-a6d0-3e7fbd1a8b2b tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1346 microversion: 2.1 time: 0.095897 Jun 24 08:42:05.929889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 106/210] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:05 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:05.958606 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-219bc0f2-bb98-41f8-917e-5891e6d82c1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:05.959222 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-219bc0f2-bb98-41f8-917e-5891e6d82c1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:05.965847 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-219bc0f2-bb98-41f8-917e-5891e6d82c1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.966291 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-219bc0f2-bb98-41f8-917e-5891e6d82c1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.967052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-219bc0f2-bb98-41f8-917e-5891e6d82c1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.967510 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-219bc0f2-bb98-41f8-917e-5891e6d82c1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.105471 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-219bc0f2-bb98-41f8-917e-5891e6d82c1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:06.114060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-219bc0f2-bb98-41f8-917e-5891e6d82c1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.159371 Jun 24 08:42:06.114637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 105/211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:05 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:06.571344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-14df8ca7-f719-4fbc-82a7-1a546e3074e9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:06.571956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-14df8ca7-f719-4fbc-82a7-1a546e3074e9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:06.577764 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14df8ca7-f719-4fbc-82a7-1a546e3074e9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.578208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14df8ca7-f719-4fbc-82a7-1a546e3074e9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.578965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14df8ca7-f719-4fbc-82a7-1a546e3074e9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.579470 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14df8ca7-f719-4fbc-82a7-1a546e3074e9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.585538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:06.716106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14df8ca7-f719-4fbc-82a7-1a546e3074e9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:06.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-14df8ca7-f719-4fbc-82a7-1a546e3074e9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1504 microversion: 2.1 time: 0.159372 Jun 24 08:42:06.727657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 107/212] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:06 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:06.947533 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a30ec6d1-cd4b-442f-acd6-e8f07abc9f98 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:06.948195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a30ec6d1-cd4b-442f-acd6-e8f07abc9f98 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:06.954660 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a30ec6d1-cd4b-442f-acd6-e8f07abc9f98 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.955119 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a30ec6d1-cd4b-442f-acd6-e8f07abc9f98 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.956498 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a30ec6d1-cd4b-442f-acd6-e8f07abc9f98 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.957074 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a30ec6d1-cd4b-442f-acd6-e8f07abc9f98 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.025602 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a30ec6d1-cd4b-442f-acd6-e8f07abc9f98 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:07.034907 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a30ec6d1-cd4b-442f-acd6-e8f07abc9f98 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1346 microversion: 2.1 time: 0.090872 Jun 24 08:42:07.035318 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 106/213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:06 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:07.132593 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-08e17a74-8851-4b15-a5fc-ab2b4f8a8b1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:07.133204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-08e17a74-8851-4b15-a5fc-ab2b4f8a8b1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:07.139429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08e17a74-8851-4b15-a5fc-ab2b4f8a8b1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.139931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08e17a74-8851-4b15-a5fc-ab2b4f8a8b1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.140626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08e17a74-8851-4b15-a5fc-ab2b4f8a8b1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.141052 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08e17a74-8851-4b15-a5fc-ab2b4f8a8b1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.290377 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-08e17a74-8851-4b15-a5fc-ab2b4f8a8b1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:07.298079 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-08e17a74-8851-4b15-a5fc-ab2b4f8a8b1f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.170741 Jun 24 08:42:07.298660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 108/214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:07 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:07.744531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a63929d0-2a26-4f01-a5eb-9dcff74f3f11 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:07.745164 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a63929d0-2a26-4f01-a5eb-9dcff74f3f11 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:07.752401 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a63929d0-2a26-4f01-a5eb-9dcff74f3f11 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.752901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a63929d0-2a26-4f01-a5eb-9dcff74f3f11 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.753671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a63929d0-2a26-4f01-a5eb-9dcff74f3f11 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.754128 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a63929d0-2a26-4f01-a5eb-9dcff74f3f11 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.898554 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a63929d0-2a26-4f01-a5eb-9dcff74f3f11 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:07.906267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a63929d0-2a26-4f01-a5eb-9dcff74f3f11 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1504 microversion: 2.1 time: 0.165534 Jun 24 08:42:07.906834 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 107/215] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:07 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:08.051894 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.052582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:08.054553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:08.059983 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.060427 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.061191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.061624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.096532 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.097191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.097653 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lazy-loading 'fault' on Instance uuid 02263624-79cc-4fbf-ad1d-8abe625c93e8 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:42:08.152585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8215c41d0c54c62b4c9fea630481000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '147d9b38796148cb996e8c61d1586b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:08.167542 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-84601fbe-591a-4797-a535-3280d2c88454 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 200 len: 1351 microversion: 2.1 time: 0.119891 Jun 24 08:42:08.168197 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 109/216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:08.319311 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7e2f30d9-ef9c-4dd1-b5ad-f3cf2c182703 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.320782 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7e2f30d9-ef9c-4dd1-b5ad-f3cf2c182703 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:08.329781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e2f30d9-ef9c-4dd1-b5ad-f3cf2c182703 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.331105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e2f30d9-ef9c-4dd1-b5ad-f3cf2c182703 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.332939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e2f30d9-ef9c-4dd1-b5ad-f3cf2c182703 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.333983 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e2f30d9-ef9c-4dd1-b5ad-f3cf2c182703 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.591784 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7e2f30d9-ef9c-4dd1-b5ad-f3cf2c182703 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:08.602772 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7e2f30d9-ef9c-4dd1-b5ad-f3cf2c182703 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.290673 Jun 24 08:42:08.603695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 108/217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:08.856422 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-85c24733-12f9-4a04-a39d-fc1dc4fb0583 req-32da338d-a116-4f64-8270-6686dd564cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3fe588b-65ae-4734-93c5-9d9b21db688b", "name": "network-vif-deleted", "tag": "1b472f9d-dba2-4d17-8a87-19cc1fe545c5"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:08.867233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-85c24733-12f9-4a04-a39d-fc1dc4fb0583 req-32da338d-a116-4f64-8270-6686dd564cb7 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.867752 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-85c24733-12f9-4a04-a39d-fc1dc4fb0583 req-32da338d-a116-4f64-8270-6686dd564cb7 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.882527 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-85c24733-12f9-4a04-a39d-fc1dc4fb0583 req-32da338d-a116-4f64-8270-6686dd564cb7 service nova] Creating event network-vif-deleted:1b472f9d-dba2-4d17-8a87-19cc1fe545c5 for instance b3fe588b-65ae-4734-93c5-9d9b21db688b on hv-cinder-84713 Jun 24 08:42:08.887571 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-85c24733-12f9-4a04-a39d-fc1dc4fb0583 req-32da338d-a116-4f64-8270-6686dd564cb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038085 Jun 24 08:42:08.888341 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 110/218] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:08.930387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1707065a-dd12-45e9-bfea-f450afb8bae2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.934233 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1707065a-dd12-45e9-bfea-f450afb8bae2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:08.948625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1707065a-dd12-45e9-bfea-f450afb8bae2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.949793 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1707065a-dd12-45e9-bfea-f450afb8bae2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.950778 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1707065a-dd12-45e9-bfea-f450afb8bae2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.951415 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1707065a-dd12-45e9-bfea-f450afb8bae2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.019528 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1707065a-dd12-45e9-bfea-f450afb8bae2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:09.028342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1707065a-dd12-45e9-bfea-f450afb8bae2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 200 len: 1298 microversion: 2.1 time: 0.106362 Jun 24 08:42:09.028970 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 109/219] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:09.187353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:09.188045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:09.195401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:09.195840 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.196834 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:09.197424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.211995 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] HTTP exception thrown: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Request method failure captured: Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 HTTP/1.1 Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiVWropXtgDIxrxhoCJU-lMFEwTTZldpUOLy_bu19PoNHIkubOpTBmrAPdr5UPmMT03Cb-ZfigMQVg4-csKm5oXbDVmhuHTJ8Re1OKh2NuyO-K6UCFQf73hXKp1owwH-s3r45FKRn1OVF3z3K0M1H0YyENK9x_6i9vcGZmtWrLEpGc Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 147d9b38796148cb996e8c61d1586b61 Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:42:09.216566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_147d9b38796148cb996e8c61d1586b61", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 147d9b38796148cb996e8c61d1586b61 Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-DeleteServersTestJSON-706857702-project Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: c8215c41d0c54c62b4c9fea630481000 Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-DeleteServersTestJSON-706857702-project Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.218094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '02263624-79cc-4fbf-ad1d-8abe625c93e8'} Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:09.218938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.220268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.222749 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Returning 404 to user: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:09.222749 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-25315bfb-e3f0-4776-bf28-ac135ea449c4 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 404 len: 111 microversion: 2.1 time: 0.034922 Jun 24 08:42:09.222749 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 111/220] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:09 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:09.338348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:09.339871 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:09.346872 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:09.347568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.348263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:09.348700 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.364652 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] HTTP exception thrown: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Request method failure captured: Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8/os-volume_attachments HTTP/1.1 Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiVWropXtgDIxrxhoCJU-lMFEwTTZldpUOLy_bu19PoNHIkubOpTBmrAPdr5UPmMT03Cb-ZfigMQVg4-csKm5oXbDVmhuHTJ8Re1OKh2NuyO-K6UCFQf73hXKp1owwH-s3r45FKRn1OVF3z3K0M1H0YyENK9x_6i9vcGZmtWrLEpGc Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 147d9b38796148cb996e8c61d1586b61 Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:42:09.368893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_147d9b38796148cb996e8c61d1586b61", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 147d9b38796148cb996e8c61d1586b61 Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-DeleteServersTestJSON-706857702-project Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: c8215c41d0c54c62b4c9fea630481000 Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-DeleteServersTestJSON-706857702-project Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.371320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'server_id': '02263624-79cc-4fbf-ad1d-8abe625c93e8'} Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:09.372232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:09.373819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:09.375187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Returning 404 to user: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:09.375187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f5c98088-bce3-466a-a5dd-543a778e4f2c tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035975 Jun 24 08:42:09.375187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 110/221] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:42:09 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:09.621223 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-189b0be2-7e1b-4921-8725-b3d2566e3f06 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:09.621871 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-189b0be2-7e1b-4921-8725-b3d2566e3f06 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:09.629400 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-189b0be2-7e1b-4921-8725-b3d2566e3f06 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:09.630224 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-189b0be2-7e1b-4921-8725-b3d2566e3f06 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.630997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-189b0be2-7e1b-4921-8725-b3d2566e3f06 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:09.631760 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-189b0be2-7e1b-4921-8725-b3d2566e3f06 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.783714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-189b0be2-7e1b-4921-8725-b3d2566e3f06 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:09.792690 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-189b0be2-7e1b-4921-8725-b3d2566e3f06 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.175854 Jun 24 08:42:09.793442 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 112/222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:09 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:10.051424 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.052117 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: b3fe588b-65ae-4734-93c5-9d9b21db688b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:10.059692 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.060693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.062359 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.063008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.080799 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] HTTP exception thrown: Instance b3fe588b-65ae-4734-93c5-9d9b21db688b could not be found. Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Request method failure captured: Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b HTTP/1.1 Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXi8--NC_sVizE7XUrIm6bvntC9AubeBejHnNI_pySQscCnUcbsX3n8bvWLTn8ofI8Cuphd-ql4cGFxsjGNZWds_GIzrc_IPe-SgUrE9BTALV3qbb2TsxeLmUc7d7A36WLi-xtq3N8c_Czy402si6wg3_sf_0v8KErmZAMNryUG98lE Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 91137dbd48fe4e6d986c350c8435bbab Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesActionsTest-702737125 Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:42:10.083274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/91137dbd48fe4e6d986c350c8435bbab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/91137dbd48fe4e6d986c350c8435bbab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/91137dbd48fe4e6d986c350c8435bbab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_91137dbd48fe4e6d986c350c8435bbab", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesActionsTest-702737125 Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 91137dbd48fe4e6d986c350c8435bbab Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesActionsTest-702737125 Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesActionsTest-702737125-project Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 740d843e5abb439b954996aaf841ed63 Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesActionsTest-702737125-project Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance b3fe588b-65ae-4734-93c5-9d9b21db688b could not be found. Jun 24 08:42:10.084476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': 'b3fe588b-65ae-4734-93c5-9d9b21db688b'} Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3fe588b-65ae-4734-93c5-9d9b21db688b could not be found. Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:10.085130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3fe588b-65ae-4734-93c5-9d9b21db688b could not be found. Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3fe588b-65ae-4734-93c5-9d9b21db688b could not be found. Jun 24 08:42:10.086182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.088564 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Returning 404 to user: Instance b3fe588b-65ae-4734-93c5-9d9b21db688b could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:10.089759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8799a6ee-6085-4b22-bb9e-763b89d96263 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b" status: 404 len: 111 microversion: 2.1 time: 0.044744 Jun 24 08:42:10.090940 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 111/223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:10 2022] GET /compute/v2.1/servers/b3fe588b-65ae-4734-93c5-9d9b21db688b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:10.248301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-226005352", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "networks": [{"uuid": "f4138681-b558-4fee-81a5-bb532db98280"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:10.319199 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] validate_networks() for [('f4138681-b558-4fee-81a5-bb532db98280', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:42:10.594393 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.594913 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:10.602169 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.602594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.603893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.604338 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.618955 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] HTTP exception thrown: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Request method failure captured: Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 HTTP/1.1 Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiVWropXtgDIxrxhoCJU-lMFEwTTZldpUOLy_bu19PoNHIkubOpTBmrAPdr5UPmMT03Cb-ZfigMQVg4-csKm5oXbDVmhuHTJ8Re1OKh2NuyO-K6UCFQf73hXKp1owwH-s3r45FKRn1OVF3z3K0M1H0YyENK9x_6i9vcGZmtWrLEpGc Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 147d9b38796148cb996e8c61d1586b61 Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:42:10.620482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_147d9b38796148cb996e8c61d1586b61", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 147d9b38796148cb996e8c61d1586b61 Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-DeleteServersTestJSON-706857702-project Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: c8215c41d0c54c62b4c9fea630481000 Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-DeleteServersTestJSON-706857702-project Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.621845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '02263624-79cc-4fbf-ad1d-8abe625c93e8'} Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:10.622484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.627944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.629809 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Returning 404 to user: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:10.629809 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-48639cb8-b190-434f-8a84-0a5eaf7d37e2 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 404 len: 111 microversion: 2.1 time: 0.031317 Jun 24 08:42:10.629809 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 112/224] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:42:10 2022] DELETE /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:10.632919 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.633734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] [instance: 02263624-79cc-4fbf-ad1d-8abe625c93e8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:10.640029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.640633 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.641406 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.641873 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.662343 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] HTTP exception thrown: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Request method failure captured: Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 HTTP/1.1 Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiVWropXtgDIxrxhoCJU-lMFEwTTZldpUOLy_bu19PoNHIkubOpTBmrAPdr5UPmMT03Cb-ZfigMQVg4-csKm5oXbDVmhuHTJ8Re1OKh2NuyO-K6UCFQf73hXKp1owwH-s3r45FKRn1OVF3z3K0M1H0YyENK9x_6i9vcGZmtWrLEpGc Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 147d9b38796148cb996e8c61d1586b61 Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:42:10.664155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/147d9b38796148cb996e8c61d1586b61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_147d9b38796148cb996e8c61d1586b61", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 147d9b38796148cb996e8c61d1586b61 Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-DeleteServersTestJSON-706857702 Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-DeleteServersTestJSON-706857702-project Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: c8215c41d0c54c62b4c9fea630481000 Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-DeleteServersTestJSON-706857702-project Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.665599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '02263624-79cc-4fbf-ad1d-8abe625c93e8'} Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:10.666417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. Jun 24 08:42:10.670264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:10.671195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] Returning 404 to user: Instance 02263624-79cc-4fbf-ad1d-8abe625c93e8 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:10.671195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bb37afc2-b869-4704-b8b1-0f1d00320044 tempest-DeleteServersTestJSON-706857702 tempest-DeleteServersTestJSON-706857702-project] 10.222.0.13 "GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8" status: 404 len: 111 microversion: 2.1 time: 0.039685 Jun 24 08:42:10.671195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 113/225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:10 2022] GET /compute/v2.1/servers/02263624-79cc-4fbf-ad1d-8abe625c93e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:10.811609 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-05e2c3e6-a5ee-4533-9e5e-077dd896745e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.812391 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-05e2c3e6-a5ee-4533-9e5e-077dd896745e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:10.819311 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05e2c3e6-a5ee-4533-9e5e-077dd896745e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.819952 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05e2c3e6-a5ee-4533-9e5e-077dd896745e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.820862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05e2c3e6-a5ee-4533-9e5e-077dd896745e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.821955 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05e2c3e6-a5ee-4533-9e5e-077dd896745e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:11.145489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:42:11.146438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:42:11.147232 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:42:11.148199 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:42:11.149330 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:42:11.163681 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:11.164467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:11.165947 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:11.166585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:11.235842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Getting quotas for project 91137dbd48fe4e6d986c350c8435bbab. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:42:11.240718 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-05e2c3e6-a5ee-4533-9e5e-077dd896745e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:11.245489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Getting quotas for user 740d843e5abb439b954996aaf841ed63 and project 91137dbd48fe4e6d986c350c8435bbab. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:42:11.254625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-05e2c3e6-a5ee-4533-9e5e-077dd896745e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.444452 Jun 24 08:42:11.255799 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 114/226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:10 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:11.270292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:42:11.272635 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:42:11.333570 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2686caff-a044-4954-a2ca-5589ccf5a388 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.089529 Jun 24 08:42:11.339693 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 113/227] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:42:11.346960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c9ff2155-c79d-45e2-8eac-4d60573f00f9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:11.348615 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c9ff2155-c79d-45e2-8eac-4d60573f00f9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:11.410426 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c9ff2155-c79d-45e2-8eac-4d60573f00f9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:11.417273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c9ff2155-c79d-45e2-8eac-4d60573f00f9 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1213 microversion: 2.1 time: 0.076721 Jun 24 08:42:11.426892 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 115/228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:11 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:12.273464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c998a318-7a25-46a6-a39f-d6deaf19f924 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:12.274865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c998a318-7a25-46a6-a39f-d6deaf19f924 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:12.282971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c998a318-7a25-46a6-a39f-d6deaf19f924 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.283811 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c998a318-7a25-46a6-a39f-d6deaf19f924 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.285279 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c998a318-7a25-46a6-a39f-d6deaf19f924 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.285947 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c998a318-7a25-46a6-a39f-d6deaf19f924 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.435721 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-730e070c-61a4-4f1c-a9ae-b4006bf0f470 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:12.437262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-730e070c-61a4-4f1c-a9ae-b4006bf0f470 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:12.446039 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-730e070c-61a4-4f1c-a9ae-b4006bf0f470 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.447157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-730e070c-61a4-4f1c-a9ae-b4006bf0f470 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.447949 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-730e070c-61a4-4f1c-a9ae-b4006bf0f470 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.449059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-730e070c-61a4-4f1c-a9ae-b4006bf0f470 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.471717 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c998a318-7a25-46a6-a39f-d6deaf19f924 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:12.481892 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c998a318-7a25-46a6-a39f-d6deaf19f924 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.213540 Jun 24 08:42:12.492046 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 114/229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:12 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:12.541812 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-730e070c-61a4-4f1c-a9ae-b4006bf0f470 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:12.549986 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-730e070c-61a4-4f1c-a9ae-b4006bf0f470 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1265 microversion: 2.1 time: 0.119407 Jun 24 08:42:12.560060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 116/230] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:12 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:13.504576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1d11e1aa-e74f-4408-a845-e3c8db753ac7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:13.506688 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1d11e1aa-e74f-4408-a845-e3c8db753ac7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:13.518747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d11e1aa-e74f-4408-a845-e3c8db753ac7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.519516 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d11e1aa-e74f-4408-a845-e3c8db753ac7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.520728 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d11e1aa-e74f-4408-a845-e3c8db753ac7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.522181 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d11e1aa-e74f-4408-a845-e3c8db753ac7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.574759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-922ad092-6fae-48dd-936f-e5957a36f4be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:13.578603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-922ad092-6fae-48dd-936f-e5957a36f4be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:13.596667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-922ad092-6fae-48dd-936f-e5957a36f4be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.598251 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-922ad092-6fae-48dd-936f-e5957a36f4be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.599268 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-922ad092-6fae-48dd-936f-e5957a36f4be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.599827 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-922ad092-6fae-48dd-936f-e5957a36f4be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.900150 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1d11e1aa-e74f-4408-a845-e3c8db753ac7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:13.913624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1d11e1aa-e74f-4408-a845-e3c8db753ac7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.416177 Jun 24 08:42:13.914238 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 115/231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:13 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:13.954018 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-922ad092-6fae-48dd-936f-e5957a36f4be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:13.964337 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-922ad092-6fae-48dd-936f-e5957a36f4be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.399163 Jun 24 08:42:13.965120 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 117/232] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:13 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:14.794143 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-13f5e47f-e2c3-4d1b-8ba8-4f857070a4d2 req-2cec15e2-3c20-43b7-8317-7006d4aedc14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26097941-773c-4dbc-b99b-b0dfd3ed781f", "tag": "dc4a7edb-bf8b-4e00-a458-60724277957a"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:14.812753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-13f5e47f-e2c3-4d1b-8ba8-4f857070a4d2 req-2cec15e2-3c20-43b7-8317-7006d4aedc14 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.813266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-13f5e47f-e2c3-4d1b-8ba8-4f857070a4d2 req-2cec15e2-3c20-43b7-8317-7006d4aedc14 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.841596 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-13f5e47f-e2c3-4d1b-8ba8-4f857070a4d2 req-2cec15e2-3c20-43b7-8317-7006d4aedc14 service nova] Creating event network-changed:dc4a7edb-bf8b-4e00-a458-60724277957a for instance 26097941-773c-4dbc-b99b-b0dfd3ed781f on hv-cinder-84713 Jun 24 08:42:14.851287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-13f5e47f-e2c3-4d1b-8ba8-4f857070a4d2 req-2cec15e2-3c20-43b7-8317-7006d4aedc14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058028 Jun 24 08:42:14.855138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 116/233] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:14.937836 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9a375805-77a1-4be8-88a9-3874e6534423 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:14.942979 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9a375805-77a1-4be8-88a9-3874e6534423 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:14.956108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a375805-77a1-4be8-88a9-3874e6534423 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.959044 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a375805-77a1-4be8-88a9-3874e6534423 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.960306 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a375805-77a1-4be8-88a9-3874e6534423 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.960954 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a375805-77a1-4be8-88a9-3874e6534423 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.986708 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2298f14b-d08b-48b8-839b-f50686c24d78 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:14.987637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2298f14b-d08b-48b8-839b-f50686c24d78 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:14.995738 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2298f14b-d08b-48b8-839b-f50686c24d78 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.996152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2298f14b-d08b-48b8-839b-f50686c24d78 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.996953 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2298f14b-d08b-48b8-839b-f50686c24d78 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.997409 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2298f14b-d08b-48b8-839b-f50686c24d78 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:15.297038 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9a375805-77a1-4be8-88a9-3874e6534423 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:15.301504 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2298f14b-d08b-48b8-839b-f50686c24d78 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:15.305727 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9a375805-77a1-4be8-88a9-3874e6534423 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.378212 Jun 24 08:42:15.306317 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 118/234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:14 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:15.309473 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2298f14b-d08b-48b8-839b-f50686c24d78 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.330608 Jun 24 08:42:15.310333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 117/235] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:14 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:16.326758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a5bde2aa-3a76-4322-a192-acb15520bb79 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:16.328145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a5bde2aa-3a76-4322-a192-acb15520bb79 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:16.332642 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dd9e9101-8d73-49c2-990b-bfdab3a34188 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:16.333404 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dd9e9101-8d73-49c2-990b-bfdab3a34188 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:16.335438 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5bde2aa-3a76-4322-a192-acb15520bb79 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.335897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5bde2aa-3a76-4322-a192-acb15520bb79 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.336664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5bde2aa-3a76-4322-a192-acb15520bb79 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.337088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5bde2aa-3a76-4322-a192-acb15520bb79 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.340862 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd9e9101-8d73-49c2-990b-bfdab3a34188 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.341311 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd9e9101-8d73-49c2-990b-bfdab3a34188 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.342137 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd9e9101-8d73-49c2-990b-bfdab3a34188 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.342577 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd9e9101-8d73-49c2-990b-bfdab3a34188 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.541989 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dd9e9101-8d73-49c2-990b-bfdab3a34188 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:16.550420 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dd9e9101-8d73-49c2-990b-bfdab3a34188 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.223400 Jun 24 08:42:16.551008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 118/236] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:16 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:16.558334 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a5bde2aa-3a76-4322-a192-acb15520bb79 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:16.569339 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a5bde2aa-3a76-4322-a192-acb15520bb79 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.246292 Jun 24 08:42:16.581073 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 119/237] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:16 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:16.678291 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c558e956-09d8-41b9-98bf-b2ba0c582e28 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Action: 'create', calling method: .version_select at 0x7f0a7c073f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-825602667"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:16.973021 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c558e956-09d8-41b9-98bf-b2ba0c582e28 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.420961 Jun 24 08:42:16.974196 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 119/238] 10.222.0.13 () {60 vars in 1154 bytes} [Fri Jun 24 08:42:16 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 423 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 08:42:16.984605 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ca8b743b-6ff9-4b01-b0ef-c6922dc87fed tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7ca06700>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:17.049896 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ca8b743b-6ff9-4b01-b0ef-c6922dc87fed tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 200 len: 344 microversion: 2.1 time: 0.068427 Jun 24 08:42:17.050667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 120/239] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:16 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:17.568122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a24562e2-932c-4140-ae14-47ba77f87a98 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:17.568642 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a24562e2-932c-4140-ae14-47ba77f87a98 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:17.575451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a24562e2-932c-4140-ae14-47ba77f87a98 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.575894 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a24562e2-932c-4140-ae14-47ba77f87a98 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.576657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a24562e2-932c-4140-ae14-47ba77f87a98 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.577087 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a24562e2-932c-4140-ae14-47ba77f87a98 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.587308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5670333e-9df3-42e1-8126-8438c14caf3e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:17.587948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5670333e-9df3-42e1-8126-8438c14caf3e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:17.593992 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5670333e-9df3-42e1-8126-8438c14caf3e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.594438 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5670333e-9df3-42e1-8126-8438c14caf3e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.595202 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5670333e-9df3-42e1-8126-8438c14caf3e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.595635 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5670333e-9df3-42e1-8126-8438c14caf3e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.783911 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a24562e2-932c-4140-ae14-47ba77f87a98 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:17.791440 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a24562e2-932c-4140-ae14-47ba77f87a98 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.227555 Jun 24 08:42:17.792024 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 120/240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:17 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:17.802283 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5670333e-9df3-42e1-8126-8438c14caf3e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:17.809945 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5670333e-9df3-42e1-8126-8438c14caf3e tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.227010 Jun 24 08:42:17.810561 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 121/241] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:17 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:18.063403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e78e0072-f1c5-42cf-8fb9-ba958b76abda tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c061af0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.112405 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e78e0072-f1c5-42cf-8fb9-ba958b76abda tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 200 len: 345 microversion: 2.1 time: 0.052599 Jun 24 08:42:18.112981 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 121/242] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:18.124494 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-40b783fd-45c6-4213-94a5-d9694ad7811c tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Action: 'create', calling method: .version_select at 0x7f0a7cb8ed30>, body: {"snapshot": {"volume_id": "e7d563e4-c20d-47d1-9184-e0499eaadd1c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-219348335"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:18.280016 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-40b783fd-45c6-4213-94a5-d9694ad7811c tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.159508 Jun 24 08:42:18.280839 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 122/243] 10.222.0.13 () {60 vars in 1161 bytes} [Fri Jun 24 08:42:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:18.291853 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b74e58e2-331b-4725-bbd2-9bd25ad373d5 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c06c0d0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.329832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b74e58e2-331b-4725-bbd2-9bd25ad373d5 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e" status: 200 len: 286 microversion: 2.1 time: 0.042249 Jun 24 08:42:18.330833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 122/244] 10.222.0.13 () {58 vars in 1250 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:18.341082 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-61830f9e-d256-4325-beda-c1970c1b12b3 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7ca16790>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.386013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-61830f9e-d256-4325-beda-c1970c1b12b3 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.045153 Jun 24 08:42:18.386013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 123/245] 10.222.0.13 () {58 vars in 1139 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:18.393943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b4407e52-0238-406e-8cba-7db990735844 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c06cc10>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.427836 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b4407e52-0238-406e-8cba-7db990735844 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e" status: 200 len: 286 microversion: 2.1 time: 0.038143 Jun 24 08:42:18.428659 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 123/246] 10.222.0.13 () {58 vars in 1250 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:18.808993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-120f9b85-9790-43e1-8a6b-cd36f2cba1f4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.809626 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-120f9b85-9790-43e1-8a6b-cd36f2cba1f4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:18.817052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-120f9b85-9790-43e1-8a6b-cd36f2cba1f4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.817582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-120f9b85-9790-43e1-8a6b-cd36f2cba1f4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.818413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-120f9b85-9790-43e1-8a6b-cd36f2cba1f4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.818849 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-120f9b85-9790-43e1-8a6b-cd36f2cba1f4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.823422 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:18.828234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-97e6dd20-1ae6-4065-8ba5-ba0874633d22 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.828915 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-97e6dd20-1ae6-4065-8ba5-ba0874633d22 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:18.836975 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97e6dd20-1ae6-4065-8ba5-ba0874633d22 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.837431 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97e6dd20-1ae6-4065-8ba5-ba0874633d22 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.838230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97e6dd20-1ae6-4065-8ba5-ba0874633d22 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.838836 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97e6dd20-1ae6-4065-8ba5-ba0874633d22 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:19.037945 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-120f9b85-9790-43e1-8a6b-cd36f2cba1f4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:19.047346 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-120f9b85-9790-43e1-8a6b-cd36f2cba1f4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.242598 Jun 24 08:42:19.048348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 124/247] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:19.059765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-97e6dd20-1ae6-4065-8ba5-ba0874633d22 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:19.061241 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-97e6dd20-1ae6-4065-8ba5-ba0874633d22 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.237713 Jun 24 08:42:19.062111 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 124/248] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:19.440684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-595ab2e9-79a9-4e49-959c-a94ecc04c986 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7ca16ca0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:19.471736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-595ab2e9-79a9-4e49-959c-a94ecc04c986 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e" status: 200 len: 286 microversion: 2.1 time: 0.034755 Jun 24 08:42:19.472357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 125/249] 10.222.0.13 () {58 vars in 1250 bytes} [Fri Jun 24 08:42:19 2022] GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:20.071415 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-589e36cf-832b-47b2-9323-30ab63494313 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:20.072013 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-589e36cf-832b-47b2-9323-30ab63494313 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:20.079719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b5a17267-531e-4690-9a12-ab8c50ecae4d tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:20.080379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b5a17267-531e-4690-9a12-ab8c50ecae4d tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:20.087116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5a17267-531e-4690-9a12-ab8c50ecae4d tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.087359 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-589e36cf-832b-47b2-9323-30ab63494313 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.087561 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5a17267-531e-4690-9a12-ab8c50ecae4d tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.087806 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-589e36cf-832b-47b2-9323-30ab63494313 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.088329 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5a17267-531e-4690-9a12-ab8c50ecae4d tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.088569 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-589e36cf-832b-47b2-9323-30ab63494313 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.088760 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5a17267-531e-4690-9a12-ab8c50ecae4d tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.089019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-589e36cf-832b-47b2-9323-30ab63494313 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.260816 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-589e36cf-832b-47b2-9323-30ab63494313 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:20.270528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-589e36cf-832b-47b2-9323-30ab63494313 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.203557 Jun 24 08:42:20.271259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 125/250] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:20 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:20.369527 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b5a17267-531e-4690-9a12-ab8c50ecae4d tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:20.380012 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b5a17267-531e-4690-9a12-ab8c50ecae4d tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.304374 Jun 24 08:42:20.380585 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 126/251] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:20 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:20.483582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6ecc8d2b-1e30-43ff-bf36-3d1a3d01fbaf tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c0615e0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:20.515036 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6ecc8d2b-1e30-43ff-bf36-3d1a3d01fbaf tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e" status: 200 len: 286 microversion: 2.1 time: 0.035162 Jun 24 08:42:20.515699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 126/252] 10.222.0.13 () {58 vars in 1250 bytes} [Fri Jun 24 08:42:20 2022] GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:21.288817 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7e027e80-27ac-42f0-bab6-31283ad58290 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:21.289430 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7e027e80-27ac-42f0-bab6-31283ad58290 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:21.296340 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e027e80-27ac-42f0-bab6-31283ad58290 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.296781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e027e80-27ac-42f0-bab6-31283ad58290 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.297550 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e027e80-27ac-42f0-bab6-31283ad58290 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.298015 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e027e80-27ac-42f0-bab6-31283ad58290 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.394056 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:21.395072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:21.399422 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c8f48679-ed97-4652-9c47-9295c5006a0a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:21.401821 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c8f48679-ed97-4652-9c47-9295c5006a0a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:21.409859 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8f48679-ed97-4652-9c47-9295c5006a0a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.410644 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8f48679-ed97-4652-9c47-9295c5006a0a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.411646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8f48679-ed97-4652-9c47-9295c5006a0a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.412088 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8f48679-ed97-4652-9c47-9295c5006a0a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.415654 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:21.454246 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7e027e80-27ac-42f0-bab6-31283ad58290 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:21.466152 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7e027e80-27ac-42f0-bab6-31283ad58290 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.180901 Jun 24 08:42:21.468581 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 127/253] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:21 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:21.527894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5d551718-f6b2-47db-87dd-ec038fddc37a tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7ca06d30>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:21.561020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5d551718-f6b2-47db-87dd-ec038fddc37a tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e" status: 200 len: 287 microversion: 2.1 time: 0.037053 Jun 24 08:42:21.562676 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 128/254] 10.222.0.13 () {58 vars in 1250 bytes} [Fri Jun 24 08:42:21 2022] GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:21.573282 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3c55756a-cf50-473f-8b31-9109b6857d37 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7ca06940>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:21.589378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c8f48679-ed97-4652-9c47-9295c5006a0a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:21.603445 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c8f48679-ed97-4652-9c47-9295c5006a0a tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.210849 Jun 24 08:42:21.614985 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 127/255] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:21 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:21.663640 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3c55756a-cf50-473f-8b31-9109b6857d37 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e" status: 202 len: 0 microversion: 2.1 time: 0.094224 Jun 24 08:42:21.666724 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 129/256] 10.222.0.13 () {58 vars in 1253 bytes} [Fri Jun 24 08:42:21 2022] DELETE /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:42:21.676220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-44368197-5bd6-4de2-9056-45f31dc4afa7 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c096040>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:21.712093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-44368197-5bd6-4de2-9056-45f31dc4afa7 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e" status: 200 len: 286 microversion: 2.1 time: 0.040499 Jun 24 08:42:21.712701 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 128/257] 10.222.0.13 () {58 vars in 1250 bytes} [Fri Jun 24 08:42:21 2022] GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:22.485013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6526383d-6835-4ac6-b38f-166f9b06f312 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.485618 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6526383d-6835-4ac6-b38f-166f9b06f312 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:22.492310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6526383d-6835-4ac6-b38f-166f9b06f312 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.492753 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6526383d-6835-4ac6-b38f-166f9b06f312 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.493533 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6526383d-6835-4ac6-b38f-166f9b06f312 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.493998 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6526383d-6835-4ac6-b38f-166f9b06f312 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.620476 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0f315074-b909-4efe-839e-c071e45fff33 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.621220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0f315074-b909-4efe-839e-c071e45fff33 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:22.628568 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0f315074-b909-4efe-839e-c071e45fff33 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.629016 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0f315074-b909-4efe-839e-c071e45fff33 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.629959 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0f315074-b909-4efe-839e-c071e45fff33 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.630467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0f315074-b909-4efe-839e-c071e45fff33 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.631990 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6526383d-6835-4ac6-b38f-166f9b06f312 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:22.639735 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6526383d-6835-4ac6-b38f-166f9b06f312 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.159078 Jun 24 08:42:22.640309 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 130/258] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:22 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:22.724460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f52d3197-3921-4a48-ac70-81a472d009d2 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7ca06550>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.754333 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-f52d3197-3921-4a48-ac70-81a472d009d2 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] HTTP exception thrown: Snapshot 768cd903-2e9a-4fb1-be97-c2a1c79b7a6e could not be found. Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f52d3197-3921-4a48-ac70-81a472d009d2 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Request method failure captured: Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e HTTP/1.1 Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjoyQotpHtCQc3mq3-0NFUcIEwjO1FI5JQ0xnClttCNfiszytwYF27qad0PKzE25GP1pQS0rKwIt3X-hDH8stGcdc2SZwEeuKiTHn9g2jVCcjVFCsj_aTnSAgDFxUSO3b-6eZ019z8XFjC5zOQ8v9LU-kotqHmRRzZ8gv0BhTcX8AM Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 68f7c00901424227acc04db187c3ca4d Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:42:22.756901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68f7c00901424227acc04db187c3ca4d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 68f7c00901424227acc04db187c3ca4d Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesSnapshotsTestJSON-953845226-project Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: fa7bf9a7cf0e49acb6ea3f90a4d29df2 Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesSnapshotsTestJSON-953845226-project Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Snapshot 768cd903-2e9a-4fb1-be97-c2a1c79b7a6e could not be found. Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '768cd903-2e9a-4fb1-be97-c2a1c79b7a6e'} Jun 24 08:42:22.758179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 768cd903-2e9a-4fb1-be97-c2a1c79b7a6e could not be found. (HTTP 404) (Request-ID: req-58a6b85d-ac55-46ea-9b97-ae2d51918d26) Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:22.758885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:42:22.759862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 768cd903-2e9a-4fb1-be97-c2a1c79b7a6e could not be found. Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 08:42:22.760823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 768cd903-2e9a-4fb1-be97-c2a1c79b7a6e could not be found. Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 768cd903-2e9a-4fb1-be97-c2a1c79b7a6e could not be found. Jun 24 08:42:22.761887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:22.764266 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f52d3197-3921-4a48-ac70-81a472d009d2 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Returning 404 to user: Snapshot 768cd903-2e9a-4fb1-be97-c2a1c79b7a6e could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:22.765232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f52d3197-3921-4a48-ac70-81a472d009d2 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e" status: 404 len: 111 microversion: 2.1 time: 0.045820 Jun 24 08:42:22.765939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 131/259] 10.222.0.13 () {58 vars in 1250 bytes} [Fri Jun 24 08:42:22 2022] GET /compute/v2.1/os-snapshots/768cd903-2e9a-4fb1-be97-c2a1c79b7a6e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:22.775277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-51065bc4-cfb1-4f77-bee3-6437ba4c94ec tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7cbc5d30>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.778763 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0f315074-b909-4efe-839e-c071e45fff33 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:22.786744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0f315074-b909-4efe-839e-c071e45fff33 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.170088 Jun 24 08:42:22.787583 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 129/260] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:22 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:22.844570 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-51065bc4-cfb1-4f77-bee3-6437ba4c94ec tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 202 len: 0 microversion: 2.1 time: 0.073294 Jun 24 08:42:22.845895 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 132/261] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:42:22 2022] DELETE /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:42:22.858631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2ea48d16-dc68-440c-93d2-b4c33cc675e1 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c0965e0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.927835 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2ea48d16-dc68-440c-93d2-b4c33cc675e1 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 200 len: 344 microversion: 2.1 time: 0.075014 Jun 24 08:42:22.928444 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 130/262] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:22 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:23.656898 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ddef6482-ff14-443d-8ef2-8862b2bc6d5f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:23.657527 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ddef6482-ff14-443d-8ef2-8862b2bc6d5f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:23.660287 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:23.665621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddef6482-ff14-443d-8ef2-8862b2bc6d5f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.666085 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddef6482-ff14-443d-8ef2-8862b2bc6d5f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.666854 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddef6482-ff14-443d-8ef2-8862b2bc6d5f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.667314 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddef6482-ff14-443d-8ef2-8862b2bc6d5f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.799798 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ddef6482-ff14-443d-8ef2-8862b2bc6d5f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:23.803675 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1dc9dae2-b349-437b-ad22-f98b527f4d0f tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:23.804496 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1dc9dae2-b349-437b-ad22-f98b527f4d0f tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:23.808949 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ddef6482-ff14-443d-8ef2-8862b2bc6d5f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.156250 Jun 24 08:42:23.809659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 133/263] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:23 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:23.810529 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1dc9dae2-b349-437b-ad22-f98b527f4d0f tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.810972 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1dc9dae2-b349-437b-ad22-f98b527f4d0f tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.811735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1dc9dae2-b349-437b-ad22-f98b527f4d0f tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.812166 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1dc9dae2-b349-437b-ad22-f98b527f4d0f tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.940206 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5ee136d3-7c7f-4284-948a-2fc2f0de0e7e tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7ca16940>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:23.951830 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1dc9dae2-b349-437b-ad22-f98b527f4d0f tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:23.962694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1dc9dae2-b349-437b-ad22-f98b527f4d0f tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.162881 Jun 24 08:42:23.963275 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 131/264] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:23 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:23.994031 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5ee136d3-7c7f-4284-948a-2fc2f0de0e7e tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 200 len: 344 microversion: 2.1 time: 0.057542 Jun 24 08:42:23.994605 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 134/265] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:23 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:24.364154 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-31aa28f0-d3e7-4e8e-9b43-5aef03a6d28b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:24.364919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-31aa28f0-d3e7-4e8e-9b43-5aef03a6d28b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:24.371910 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31aa28f0-d3e7-4e8e-9b43-5aef03a6d28b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.372362 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31aa28f0-d3e7-4e8e-9b43-5aef03a6d28b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.373393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31aa28f0-d3e7-4e8e-9b43-5aef03a6d28b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.373870 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31aa28f0-d3e7-4e8e-9b43-5aef03a6d28b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.398754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-31aa28f0-d3e7-4e8e-9b43-5aef03a6d28b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/ips" status: 200 len: 146 microversion: 2.1 time: 0.041472 Jun 24 08:42:24.399248 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 132/266] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:42:24 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:24.577581 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-788e93bb-c70b-4a3b-8bc5-f5291d9d700a req-5af73e06-20fa-4386-88d1-056db5f51512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26097941-773c-4dbc-b99b-b0dfd3ed781f", "name": "network-vif-plugged", "status": "completed", "tag": "dc4a7edb-bf8b-4e00-a458-60724277957a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:24.586377 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-788e93bb-c70b-4a3b-8bc5-f5291d9d700a req-5af73e06-20fa-4386-88d1-056db5f51512 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.586874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-788e93bb-c70b-4a3b-8bc5-f5291d9d700a req-5af73e06-20fa-4386-88d1-056db5f51512 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.598923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-788e93bb-c70b-4a3b-8bc5-f5291d9d700a req-5af73e06-20fa-4386-88d1-056db5f51512 service nova] Creating event network-vif-plugged:dc4a7edb-bf8b-4e00-a458-60724277957a for instance 26097941-773c-4dbc-b99b-b0dfd3ed781f on hv-cinder-84713 Jun 24 08:42:24.603946 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-788e93bb-c70b-4a3b-8bc5-f5291d9d700a req-5af73e06-20fa-4386-88d1-056db5f51512 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030146 Jun 24 08:42:24.604594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 135/267] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:24.826938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cd69c702-98fd-4487-9017-342eaaa3df2b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:24.827558 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cd69c702-98fd-4487-9017-342eaaa3df2b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:24.834576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd69c702-98fd-4487-9017-342eaaa3df2b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.835019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd69c702-98fd-4487-9017-342eaaa3df2b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.835803 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd69c702-98fd-4487-9017-342eaaa3df2b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.836241 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd69c702-98fd-4487-9017-342eaaa3df2b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.859540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:24.980859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff1f570b-9137-45ed-baa6-adc8d4a60004 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:24.981596 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ff1f570b-9137-45ed-baa6-adc8d4a60004 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:24.983482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cd69c702-98fd-4487-9017-342eaaa3df2b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:24.989361 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff1f570b-9137-45ed-baa6-adc8d4a60004 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.989903 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff1f570b-9137-45ed-baa6-adc8d4a60004 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.990673 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff1f570b-9137-45ed-baa6-adc8d4a60004 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.991103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff1f570b-9137-45ed-baa6-adc8d4a60004 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.992589 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cd69c702-98fd-4487-9017-342eaaa3df2b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.169508 Jun 24 08:42:24.993164 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 133/268] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:24 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:25.008850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ef0ae1be-f019-4fe7-9805-88765944a2f1 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c096280>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:25.070258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ef0ae1be-f019-4fe7-9805-88765944a2f1 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 200 len: 344 microversion: 2.1 time: 0.065378 Jun 24 08:42:25.070832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 134/269] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:25 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:25.131214 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ff1f570b-9137-45ed-baa6-adc8d4a60004 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:25.138592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ff1f570b-9137-45ed-baa6-adc8d4a60004 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.162852 Jun 24 08:42:25.139145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 136/270] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:24 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:26.010923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e317103f-a576-4173-851c-a42343a01208 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:26.011533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e317103f-a576-4173-851c-a42343a01208 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:26.018302 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e317103f-a576-4173-851c-a42343a01208 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.019103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e317103f-a576-4173-851c-a42343a01208 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.019732 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e317103f-a576-4173-851c-a42343a01208 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.020168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e317103f-a576-4173-851c-a42343a01208 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.083754 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9622606e-ea46-4147-9113-b305f3ac67ee tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7cabf820>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:26.139039 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9622606e-ea46-4147-9113-b305f3ac67ee tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 200 len: 344 microversion: 2.1 time: 0.060080 Jun 24 08:42:26.139791 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 137/271] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:26 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:26.155388 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-971808af-a426-4707-82d0-3048c6e6adfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:26.156004 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-971808af-a426-4707-82d0-3048c6e6adfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:26.160701 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e317103f-a576-4173-851c-a42343a01208 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:26.163310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-971808af-a426-4707-82d0-3048c6e6adfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.163763 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-971808af-a426-4707-82d0-3048c6e6adfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.164540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-971808af-a426-4707-82d0-3048c6e6adfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.164975 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-971808af-a426-4707-82d0-3048c6e6adfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.168311 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e317103f-a576-4173-851c-a42343a01208 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.161254 Jun 24 08:42:26.168876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 135/272] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:26 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:26.302446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-971808af-a426-4707-82d0-3048c6e6adfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:26.309918 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-971808af-a426-4707-82d0-3048c6e6adfd tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.158345 Jun 24 08:42:26.310486 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 138/273] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:26 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:27.151535 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d0d9228f-2bc6-46a6-ba16-28f6f30e0e39 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c096b80>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:27.185473 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8ff2b689-6f23-47ba-957f-6c3230f5c896 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:27.186105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8ff2b689-6f23-47ba-957f-6c3230f5c896 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:27.193203 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8ff2b689-6f23-47ba-957f-6c3230f5c896 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.193637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8ff2b689-6f23-47ba-957f-6c3230f5c896 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.194416 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8ff2b689-6f23-47ba-957f-6c3230f5c896 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.194846 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8ff2b689-6f23-47ba-957f-6c3230f5c896 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.199696 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d0d9228f-2bc6-46a6-ba16-28f6f30e0e39 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 200 len: 344 microversion: 2.1 time: 0.051894 Jun 24 08:42:27.200266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 136/274] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:27 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:27.325171 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8ff2b689-6f23-47ba-957f-6c3230f5c896 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:27.327291 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-62f9e6c7-6f9f-4d30-a1d2-c65d52d4b063 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:27.327906 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-62f9e6c7-6f9f-4d30-a1d2-c65d52d4b063 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:27.334135 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8ff2b689-6f23-47ba-957f-6c3230f5c896 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.152357 Jun 24 08:42:27.334705 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 139/275] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:27 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:27.335097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62f9e6c7-6f9f-4d30-a1d2-c65d52d4b063 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.335545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62f9e6c7-6f9f-4d30-a1d2-c65d52d4b063 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.336305 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62f9e6c7-6f9f-4d30-a1d2-c65d52d4b063 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.336734 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62f9e6c7-6f9f-4d30-a1d2-c65d52d4b063 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.469151 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-62f9e6c7-6f9f-4d30-a1d2-c65d52d4b063 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:27.477258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-62f9e6c7-6f9f-4d30-a1d2-c65d52d4b063 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.154933 Jun 24 08:42:27.477861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 137/276] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:27 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:28.212154 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-266a8811-7eb2-4962-8ead-6d4452b3b6fa tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c8deee0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:28.259044 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-266a8811-7eb2-4962-8ead-6d4452b3b6fa tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 200 len: 344 microversion: 2.1 time: 0.050643 Jun 24 08:42:28.259605 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 140/277] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:28 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:28.352138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-810b2b36-c528-4cfb-9783-8e21bf479075 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:28.352906 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-810b2b36-c528-4cfb-9783-8e21bf479075 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:28.362401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-810b2b36-c528-4cfb-9783-8e21bf479075 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.362852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-810b2b36-c528-4cfb-9783-8e21bf479075 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.363623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-810b2b36-c528-4cfb-9783-8e21bf479075 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.364060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-810b2b36-c528-4cfb-9783-8e21bf479075 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.493939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5a53771d-fc03-4b55-845d-efc650def3a5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:28.494542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5a53771d-fc03-4b55-845d-efc650def3a5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:28.499658 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-810b2b36-c528-4cfb-9783-8e21bf479075 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:28.501022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a53771d-fc03-4b55-845d-efc650def3a5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.501514 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a53771d-fc03-4b55-845d-efc650def3a5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.502839 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a53771d-fc03-4b55-845d-efc650def3a5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.503015 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a53771d-fc03-4b55-845d-efc650def3a5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.507184 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-810b2b36-c528-4cfb-9783-8e21bf479075 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.159397 Jun 24 08:42:28.507859 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 138/278] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:28 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:28.632348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5a53771d-fc03-4b55-845d-efc650def3a5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:28.640001 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5a53771d-fc03-4b55-845d-efc650def3a5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.150000 Jun 24 08:42:28.640554 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 141/279] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:28 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:29.276279 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-582b4124-b050-4428-89b5-c514c8379b48 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c06c790>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.306959 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-582b4124-b050-4428-89b5-c514c8379b48 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] HTTP exception thrown: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-582b4124-b050-4428-89b5-c514c8379b48 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Request method failure captured: Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c HTTP/1.1 Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjoyQotpHtCQc3mq3-0NFUcIEwjO1FI5JQ0xnClttCNfiszytwYF27qad0PKzE25GP1pQS0rKwIt3X-hDH8stGcdc2SZwEeuKiTHn9g2jVCcjVFCsj_aTnSAgDFxUSO3b-6eZ019z8XFjC5zOQ8v9LU-kotqHmRRzZ8gv0BhTcX8AM Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 68f7c00901424227acc04db187c3ca4d Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:42:29.309122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68f7c00901424227acc04db187c3ca4d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 68f7c00901424227acc04db187c3ca4d Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotsTestJSON-953845226-project Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: fa7bf9a7cf0e49acb6ea3f90a4d29df2 Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-953845226-project Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'e7d563e4-c20d-47d1-9184-e0499eaadd1c'} Jun 24 08:42:29.310655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. (HTTP 404) (Request-ID: req-567d8228-919f-4674-acdc-c563e3fe5dcd) Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.311573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:42:29.312897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:42:29.314964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-582b4124-b050-4428-89b5-c514c8379b48 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Returning 404 to user: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-582b4124-b050-4428-89b5-c514c8379b48 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 404 len: 109 microversion: 2.1 time: 0.042118 Jun 24 08:42:29.316416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 139/280] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:29 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:29.325149 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a1b49191-8123-49f4-bb7d-891b9b741256 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7cc42310>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.354258 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-a1b49191-8123-49f4-bb7d-891b9b741256 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] HTTP exception thrown: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a1b49191-8123-49f4-bb7d-891b9b741256 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Request method failure captured: Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c HTTP/1.1 Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjoyQotpHtCQc3mq3-0NFUcIEwjO1FI5JQ0xnClttCNfiszytwYF27qad0PKzE25GP1pQS0rKwIt3X-hDH8stGcdc2SZwEeuKiTHn9g2jVCcjVFCsj_aTnSAgDFxUSO3b-6eZ019z8XFjC5zOQ8v9LU-kotqHmRRzZ8gv0BhTcX8AM Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 68f7c00901424227acc04db187c3ca4d Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:42:29.356310 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68f7c00901424227acc04db187c3ca4d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 68f7c00901424227acc04db187c3ca4d Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesSnapshotsTestJSON-953845226-project Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: fa7bf9a7cf0e49acb6ea3f90a4d29df2 Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesSnapshotsTestJSON-953845226-project Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': 'e7d563e4-c20d-47d1-9184-e0499eaadd1c'} Jun 24 08:42:29.357874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. (HTTP 404) (Request-ID: req-af351b94-cc29-4e90-843d-fa8fdc582558) Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.358923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:42:29.360190 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:42:29.362336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a1b49191-8123-49f4-bb7d-891b9b741256 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Returning 404 to user: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a1b49191-8123-49f4-bb7d-891b9b741256 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 404 len: 109 microversion: 2.1 time: 0.036430 Jun 24 08:42:29.363666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 142/281] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:42:29 2022] DELETE /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:29.367023 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-338bffd1-6b43-4328-a482-21f87d7ec140 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Calling method '.version_select at 0x7f0a7c0615e0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.395459 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-338bffd1-6b43-4328-a482-21f87d7ec140 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] HTTP exception thrown: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-338bffd1-6b43-4328-a482-21f87d7ec140 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Request method failure captured: Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c HTTP/1.1 Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjoyQotpHtCQc3mq3-0NFUcIEwjO1FI5JQ0xnClttCNfiszytwYF27qad0PKzE25GP1pQS0rKwIt3X-hDH8stGcdc2SZwEeuKiTHn9g2jVCcjVFCsj_aTnSAgDFxUSO3b-6eZ019z8XFjC5zOQ8v9LU-kotqHmRRzZ8gv0BhTcX8AM Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 68f7c00901424227acc04db187c3ca4d Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:42:29.397389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/68f7c00901424227acc04db187c3ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_68f7c00901424227acc04db187c3ca4d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 68f7c00901424227acc04db187c3ca4d Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-953845226 Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotsTestJSON-953845226-project Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: fa7bf9a7cf0e49acb6ea3f90a4d29df2 Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-953845226-project Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'e7d563e4-c20d-47d1-9184-e0499eaadd1c'} Jun 24 08:42:29.398648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. (HTTP 404) (Request-ID: req-f1f67649-869d-49b2-abcf-807babeedaf6) Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.399314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:42:29.400343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:42:29.401342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-338bffd1-6b43-4328-a482-21f87d7ec140 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] Returning 404 to user: Volume e7d563e4-c20d-47d1-9184-e0499eaadd1c could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-338bffd1-6b43-4328-a482-21f87d7ec140 tempest-VolumesSnapshotsTestJSON-953845226 tempest-VolumesSnapshotsTestJSON-953845226-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c" status: 404 len: 109 microversion: 2.1 time: 0.035527 Jun 24 08:42:29.402491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 140/282] 10.222.0.13 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:29 2022] GET /compute/v2.1/os-volumes/e7d563e4-c20d-47d1-9184-e0499eaadd1c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:42:29.529528 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae4d3fe6-0d07-4602-9b89-add6220d9b40 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.530877 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ae4d3fe6-0d07-4602-9b89-add6220d9b40 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:29.537854 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae4d3fe6-0d07-4602-9b89-add6220d9b40 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.538307 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae4d3fe6-0d07-4602-9b89-add6220d9b40 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.539088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae4d3fe6-0d07-4602-9b89-add6220d9b40 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.539531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae4d3fe6-0d07-4602-9b89-add6220d9b40 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.661725 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2dac1c07-ceed-4bce-b60b-84238e974981 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.662345 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2dac1c07-ceed-4bce-b60b-84238e974981 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:29.672776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2dac1c07-ceed-4bce-b60b-84238e974981 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.673236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2dac1c07-ceed-4bce-b60b-84238e974981 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.674292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2dac1c07-ceed-4bce-b60b-84238e974981 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.675036 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2dac1c07-ceed-4bce-b60b-84238e974981 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.752497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae4d3fe6-0d07-4602-9b89-add6220d9b40 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:29.764769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ae4d3fe6-0d07-4602-9b89-add6220d9b40 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.238807 Jun 24 08:42:29.775792 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 143/283] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:29 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:29.866919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2dac1c07-ceed-4bce-b60b-84238e974981 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:29.876520 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2dac1c07-ceed-4bce-b60b-84238e974981 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1313 microversion: 2.1 time: 0.223140 Jun 24 08:42:29.877789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 141/284] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:29 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:30.194677 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-561777c6-e41e-4875-9431-1583f244aa24 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3419c7ca-65a0-4088-84e9-4c9dfaa711b1"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:30.195815 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-561777c6-e41e-4875-9431-1583f244aa24 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:30.201625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-561777c6-e41e-4875-9431-1583f244aa24 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.202189 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-561777c6-e41e-4875-9431-1583f244aa24 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.203022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-561777c6-e41e-4875-9431-1583f244aa24 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.203550 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-561777c6-e41e-4875-9431-1583f244aa24 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.783631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ba30e0ac-f698-4430-a5ac-8120b3bd0de0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:30.784628 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ba30e0ac-f698-4430-a5ac-8120b3bd0de0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:30.791238 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba30e0ac-f698-4430-a5ac-8120b3bd0de0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.791685 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba30e0ac-f698-4430-a5ac-8120b3bd0de0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.792465 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba30e0ac-f698-4430-a5ac-8120b3bd0de0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.792903 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba30e0ac-f698-4430-a5ac-8120b3bd0de0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.926675 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ba30e0ac-f698-4430-a5ac-8120b3bd0de0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:30.934462 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ba30e0ac-f698-4430-a5ac-8120b3bd0de0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.155313 Jun 24 08:42:30.935039 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 142/285] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:30 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:30.940214 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a04e6444-4fc0-4e6b-8056-6df6403a50f5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:30.940756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a04e6444-4fc0-4e6b-8056-6df6403a50f5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:30.946631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a04e6444-4fc0-4e6b-8056-6df6403a50f5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.947071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a04e6444-4fc0-4e6b-8056-6df6403a50f5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.947830 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a04e6444-4fc0-4e6b-8056-6df6403a50f5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.948264 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a04e6444-4fc0-4e6b-8056-6df6403a50f5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.092093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a04e6444-4fc0-4e6b-8056-6df6403a50f5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:31.100645 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a04e6444-4fc0-4e6b-8056-6df6403a50f5 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1498 microversion: 2.1 time: 0.164587 Jun 24 08:42:31.101216 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 143/286] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:30 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:31.951890 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-899141a9-50be-4e9b-b508-d63ff9c36fff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:31.952549 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-899141a9-50be-4e9b-b508-d63ff9c36fff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:31.958935 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-899141a9-50be-4e9b-b508-d63ff9c36fff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.959329 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-899141a9-50be-4e9b-b508-d63ff9c36fff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.960094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-899141a9-50be-4e9b-b508-d63ff9c36fff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.960533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-899141a9-50be-4e9b-b508-d63ff9c36fff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:32.090144 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-899141a9-50be-4e9b-b508-d63ff9c36fff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:32.098168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-899141a9-50be-4e9b-b508-d63ff9c36fff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.150130 Jun 24 08:42:32.098748 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 144/287] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:31 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:33.116564 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-589b8703-738c-4c95-84c9-aa040b4f605f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:33.117222 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-589b8703-738c-4c95-84c9-aa040b4f605f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:33.123545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-589b8703-738c-4c95-84c9-aa040b4f605f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:33.124021 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-589b8703-738c-4c95-84c9-aa040b4f605f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.124846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-589b8703-738c-4c95-84c9-aa040b4f605f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:33.125281 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-589b8703-738c-4c95-84c9-aa040b4f605f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.335353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-589b8703-738c-4c95-84c9-aa040b4f605f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:33.343657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-589b8703-738c-4c95-84c9-aa040b4f605f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.232025 Jun 24 08:42:33.344677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 145/288] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:33 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:33.675803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-561777c6-e41e-4875-9431-1583f244aa24 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.484737 Jun 24 08:42:33.676499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 144/289] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:42:30 2022] POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/os-volume_attachments => generated 194 bytes in 3486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:33.879988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-97bb008a-8ad9-44d7-99ed-0a7543bed7e3 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:33.880489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-97bb008a-8ad9-44d7-99ed-0a7543bed7e3 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:33.887917 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97bb008a-8ad9-44d7-99ed-0a7543bed7e3 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:33.888534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97bb008a-8ad9-44d7-99ed-0a7543bed7e3 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.889139 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97bb008a-8ad9-44d7-99ed-0a7543bed7e3 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:33.889579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97bb008a-8ad9-44d7-99ed-0a7543bed7e3 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.916602 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-97bb008a-8ad9-44d7-99ed-0a7543bed7e3 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:42:33.995451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-97bb008a-8ad9-44d7-99ed-0a7543bed7e3 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "DELETE /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 204 len: 0 microversion: 2.1 time: 0.120586 Jun 24 08:42:33.996048 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 146/290] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:42:33 2022] DELETE /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:42:34.007208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-23863abb-b12c-4d5e-9f5d-f293d6ce7ec2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:34.008210 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-23863abb-b12c-4d5e-9f5d-f293d6ce7ec2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:34.014828 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23863abb-b12c-4d5e-9f5d-f293d6ce7ec2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.015267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23863abb-b12c-4d5e-9f5d-f293d6ce7ec2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.016015 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23863abb-b12c-4d5e-9f5d-f293d6ce7ec2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.016445 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23863abb-b12c-4d5e-9f5d-f293d6ce7ec2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.157100 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-23863abb-b12c-4d5e-9f5d-f293d6ce7ec2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:34.165389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-23863abb-b12c-4d5e-9f5d-f293d6ce7ec2 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1504 microversion: 2.1 time: 0.164018 Jun 24 08:42:34.166225 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 145/291] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:33 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:34.363447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f41b7378-67b9-4383-8723-58f051567537 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:34.364172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f41b7378-67b9-4383-8723-58f051567537 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:34.370373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f41b7378-67b9-4383-8723-58f051567537 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.370812 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f41b7378-67b9-4383-8723-58f051567537 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.371573 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f41b7378-67b9-4383-8723-58f051567537 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.372006 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f41b7378-67b9-4383-8723-58f051567537 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.514296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f41b7378-67b9-4383-8723-58f051567537 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:34.523706 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f41b7378-67b9-4383-8723-58f051567537 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.165308 Jun 24 08:42:34.524292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 147/292] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:34 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:35.184079 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0c2f66a8-91b8-4c67-b585-cc585263c0cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:35.184667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0c2f66a8-91b8-4c67-b585-cc585263c0cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:35.191956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c2f66a8-91b8-4c67-b585-cc585263c0cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.192404 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c2f66a8-91b8-4c67-b585-cc585263c0cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.193160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c2f66a8-91b8-4c67-b585-cc585263c0cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.193589 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c2f66a8-91b8-4c67-b585-cc585263c0cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.540606 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-344aaa6b-2d42-46c6-b28f-21bcb02d6535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:35.541257 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-344aaa6b-2d42-46c6-b28f-21bcb02d6535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:35.547418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-344aaa6b-2d42-46c6-b28f-21bcb02d6535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.547858 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-344aaa6b-2d42-46c6-b28f-21bcb02d6535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.549191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-344aaa6b-2d42-46c6-b28f-21bcb02d6535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.549635 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-344aaa6b-2d42-46c6-b28f-21bcb02d6535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.556862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0c2f66a8-91b8-4c67-b585-cc585263c0cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:35.564261 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0c2f66a8-91b8-4c67-b585-cc585263c0cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1504 microversion: 2.1 time: 0.384033 Jun 24 08:42:35.564977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 146/293] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:35 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:35.683030 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-344aaa6b-2d42-46c6-b28f-21bcb02d6535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:35.692561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-344aaa6b-2d42-46c6-b28f-21bcb02d6535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.155852 Jun 24 08:42:35.693278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 148/294] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:35 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:36.583200 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6e8be766-2c66-45d8-ad6f-1f13854eaaab tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:36.583809 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6e8be766-2c66-45d8-ad6f-1f13854eaaab tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:36.590254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e8be766-2c66-45d8-ad6f-1f13854eaaab tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.590691 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e8be766-2c66-45d8-ad6f-1f13854eaaab tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.591448 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e8be766-2c66-45d8-ad6f-1f13854eaaab tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.591874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e8be766-2c66-45d8-ad6f-1f13854eaaab tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.711376 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-74e1718b-16ef-4dda-8450-5653722748a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:36.712056 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-74e1718b-16ef-4dda-8450-5653722748a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:36.719545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-74e1718b-16ef-4dda-8450-5653722748a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.720042 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-74e1718b-16ef-4dda-8450-5653722748a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.721371 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-74e1718b-16ef-4dda-8450-5653722748a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.721957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-74e1718b-16ef-4dda-8450-5653722748a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.729366 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6e8be766-2c66-45d8-ad6f-1f13854eaaab tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:36.737206 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6e8be766-2c66-45d8-ad6f-1f13854eaaab tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1504 microversion: 2.1 time: 0.160182 Jun 24 08:42:36.737805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 147/295] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:36 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:36.850885 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-74e1718b-16ef-4dda-8450-5653722748a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:36.858898 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-74e1718b-16ef-4dda-8450-5653722748a6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.151484 Jun 24 08:42:36.859746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 149/296] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:36 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:37.754118 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6313260a-dc0f-42c0-8a2b-efcd1c0222cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:37.754730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6313260a-dc0f-42c0-8a2b-efcd1c0222cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:37.761257 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6313260a-dc0f-42c0-8a2b-efcd1c0222cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:37.762070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6313260a-dc0f-42c0-8a2b-efcd1c0222cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.763160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6313260a-dc0f-42c0-8a2b-efcd1c0222cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:37.763750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6313260a-dc0f-42c0-8a2b-efcd1c0222cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.876133 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e314653a-3448-43d7-90a6-45378d230e8a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:37.876780 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e314653a-3448-43d7-90a6-45378d230e8a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:37.886915 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e314653a-3448-43d7-90a6-45378d230e8a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:37.887381 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e314653a-3448-43d7-90a6-45378d230e8a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.888159 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e314653a-3448-43d7-90a6-45378d230e8a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:37.888728 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e314653a-3448-43d7-90a6-45378d230e8a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.915972 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6313260a-dc0f-42c0-8a2b-efcd1c0222cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:37.924870 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6313260a-dc0f-42c0-8a2b-efcd1c0222cc tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1504 microversion: 2.1 time: 0.173620 Jun 24 08:42:37.935494 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 148/297] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:37 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:38.051365 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e314653a-3448-43d7-90a6-45378d230e8a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:38.059930 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e314653a-3448-43d7-90a6-45378d230e8a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.187744 Jun 24 08:42:38.060515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 150/298] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:37 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:38.951835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2edbae80-d74f-441a-bee5-bfc25d5ad5db tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:38.952443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2edbae80-d74f-441a-bee5-bfc25d5ad5db tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:38.959601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2edbae80-d74f-441a-bee5-bfc25d5ad5db tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.960042 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2edbae80-d74f-441a-bee5-bfc25d5ad5db tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.960806 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2edbae80-d74f-441a-bee5-bfc25d5ad5db tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.961237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2edbae80-d74f-441a-bee5-bfc25d5ad5db tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.965329 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:39.076167 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4ba35846-a3cc-404d-9368-5b493cbaf22c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:39.076863 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4ba35846-a3cc-404d-9368-5b493cbaf22c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:39.079155 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:39.085905 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ba35846-a3cc-404d-9368-5b493cbaf22c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:39.086337 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ba35846-a3cc-404d-9368-5b493cbaf22c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:39.087100 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ba35846-a3cc-404d-9368-5b493cbaf22c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:39.087533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ba35846-a3cc-404d-9368-5b493cbaf22c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:39.096301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2edbae80-d74f-441a-bee5-bfc25d5ad5db tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:39.103770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2edbae80-d74f-441a-bee5-bfc25d5ad5db tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1504 microversion: 2.1 time: 0.155747 Jun 24 08:42:39.104346 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 149/299] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:38 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:39.228866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4ba35846-a3cc-404d-9368-5b493cbaf22c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:39.236444 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4ba35846-a3cc-404d-9368-5b493cbaf22c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.164073 Jun 24 08:42:39.237019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 151/300] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:39 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:40.122023 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff40ced6-f74a-4b73-9e60-b50701a179e8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:40.122728 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ff40ced6-f74a-4b73-9e60-b50701a179e8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:40.130164 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff40ced6-f74a-4b73-9e60-b50701a179e8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.130605 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff40ced6-f74a-4b73-9e60-b50701a179e8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.131372 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff40ced6-f74a-4b73-9e60-b50701a179e8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.131810 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff40ced6-f74a-4b73-9e60-b50701a179e8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.254944 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-479cdcb3-e35e-4036-a5dc-43c7f11d27aa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:40.255594 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-479cdcb3-e35e-4036-a5dc-43c7f11d27aa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:40.261878 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-479cdcb3-e35e-4036-a5dc-43c7f11d27aa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.262321 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-479cdcb3-e35e-4036-a5dc-43c7f11d27aa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.263263 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-479cdcb3-e35e-4036-a5dc-43c7f11d27aa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.263492 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ff40ced6-f74a-4b73-9e60-b50701a179e8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:40.263768 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-479cdcb3-e35e-4036-a5dc-43c7f11d27aa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.271491 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ff40ced6-f74a-4b73-9e60-b50701a179e8 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1504 microversion: 2.1 time: 0.153531 Jun 24 08:42:40.272066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 150/301] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:40 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:40.282988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:40.406186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-479cdcb3-e35e-4036-a5dc-43c7f11d27aa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:40.413640 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-479cdcb3-e35e-4036-a5dc-43c7f11d27aa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.163260 Jun 24 08:42:40.414240 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 152/302] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:40 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:41.290561 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6719f00d-7e5e-40eb-8026-2186119fb3be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:41.291269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6719f00d-7e5e-40eb-8026-2186119fb3be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:41.298758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6719f00d-7e5e-40eb-8026-2186119fb3be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.299834 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6719f00d-7e5e-40eb-8026-2186119fb3be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.300622 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6719f00d-7e5e-40eb-8026-2186119fb3be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.301060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6719f00d-7e5e-40eb-8026-2186119fb3be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.447585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-26e3873b-6332-476a-ba8e-e4d5e4c9525a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:41.448220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-26e3873b-6332-476a-ba8e-e4d5e4c9525a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:41.463625 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26e3873b-6332-476a-ba8e-e4d5e4c9525a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.464418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26e3873b-6332-476a-ba8e-e4d5e4c9525a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.466187 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26e3873b-6332-476a-ba8e-e4d5e4c9525a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.466698 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26e3873b-6332-476a-ba8e-e4d5e4c9525a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.718066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6719f00d-7e5e-40eb-8026-2186119fb3be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:41.729417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6719f00d-7e5e-40eb-8026-2186119fb3be tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1504 microversion: 2.1 time: 0.443969 Jun 24 08:42:41.730477 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 151/303] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:41 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:41.803400 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26e3873b-6332-476a-ba8e-e4d5e4c9525a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:41.812568 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-26e3873b-6332-476a-ba8e-e4d5e4c9525a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.381221 Jun 24 08:42:41.813150 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 153/304] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:41 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:42.134888 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-5cb5262b-71ee-4ac5-92f7-2e065431dfeb req-9e732a7f-7761-46e9-b4ec-57239fc0ce03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26097941-773c-4dbc-b99b-b0dfd3ed781f", "name": "network-vif-deleted", "tag": "dc4a7edb-bf8b-4e00-a458-60724277957a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:42.144488 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5cb5262b-71ee-4ac5-92f7-2e065431dfeb req-9e732a7f-7761-46e9-b4ec-57239fc0ce03 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:42.144927 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5cb5262b-71ee-4ac5-92f7-2e065431dfeb req-9e732a7f-7761-46e9-b4ec-57239fc0ce03 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.155863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-5cb5262b-71ee-4ac5-92f7-2e065431dfeb req-9e732a7f-7761-46e9-b4ec-57239fc0ce03 service nova] Creating event network-vif-deleted:dc4a7edb-bf8b-4e00-a458-60724277957a for instance 26097941-773c-4dbc-b99b-b0dfd3ed781f on hv-cinder-84713 Jun 24 08:42:42.161927 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-5cb5262b-71ee-4ac5-92f7-2e065431dfeb req-9e732a7f-7761-46e9-b4ec-57239fc0ce03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 Jun 24 08:42:42.162516 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 152/305] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:42.746979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:42.748033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:42.755324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:42.755767 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.756527 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:42.756960 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.794998 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:42.795455 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.796063 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lazy-loading 'fault' on Instance uuid 26097941-773c-4dbc-b99b-b0dfd3ed781f {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:42:42.829926 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eb52a17f-2b87-493f-9e1d-9d8544a94c81 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:42.830844 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eb52a17f-2b87-493f-9e1d-9d8544a94c81 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:42.838248 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb52a17f-2b87-493f-9e1d-9d8544a94c81 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:42.838767 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb52a17f-2b87-493f-9e1d-9d8544a94c81 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.839516 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb52a17f-2b87-493f-9e1d-9d8544a94c81 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:42.840031 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:42.840421 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb52a17f-2b87-493f-9e1d-9d8544a94c81 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.849518 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5683b5ed-1057-49b7-972d-05d703fe1244 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1303 microversion: 2.1 time: 0.106282 Jun 24 08:42:42.850402 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 154/306] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:42 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:42.993793 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eb52a17f-2b87-493f-9e1d-9d8544a94c81 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:43.002850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eb52a17f-2b87-493f-9e1d-9d8544a94c81 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1520 microversion: 2.1 time: 0.177548 Jun 24 08:42:43.003427 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 153/307] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:42 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:43.868741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:43.869392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:43.875886 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:43.876836 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:43.878567 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:43.879010 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:43.914243 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:43.914720 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:43.915174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lazy-loading 'fault' on Instance uuid 26097941-773c-4dbc-b99b-b0dfd3ed781f {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:42:43.958692 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740d843e5abb439b954996aaf841ed63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91137dbd48fe4e6d986c350c8435bbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:43.965428 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ca81eb99-a529-4c8f-941c-6bab53c9ba41 tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 200 len: 1303 microversion: 2.1 time: 0.100719 Jun 24 08:42:43.966029 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 155/308] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:43 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:44.019965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ce8ed21c-4cb4-4b3b-9566-66fee1bcac89 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:44.020579 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ce8ed21c-4cb4-4b3b-9566-66fee1bcac89 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:44.027185 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce8ed21c-4cb4-4b3b-9566-66fee1bcac89 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.027634 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce8ed21c-4cb4-4b3b-9566-66fee1bcac89 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:44.028405 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce8ed21c-4cb4-4b3b-9566-66fee1bcac89 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.028840 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce8ed21c-4cb4-4b3b-9566-66fee1bcac89 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:44.177440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ce8ed21c-4cb4-4b3b-9566-66fee1bcac89 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:44.187698 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ce8ed21c-4cb4-4b3b-9566-66fee1bcac89 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1500 microversion: 2.1 time: 0.171510 Jun 24 08:42:44.189450 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 154/309] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:44 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:44.207041 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b64e743c-5f04-43fa-8662-583dcd2239fe tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:44.210715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b64e743c-5f04-43fa-8662-583dcd2239fe tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:44.218009 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b64e743c-5f04-43fa-8662-583dcd2239fe tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.218266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b64e743c-5f04-43fa-8662-583dcd2239fe tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:44.219874 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b64e743c-5f04-43fa-8662-583dcd2239fe tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.220509 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b64e743c-5f04-43fa-8662-583dcd2239fe tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:44.378714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b64e743c-5f04-43fa-8662-583dcd2239fe tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:44.386097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b64e743c-5f04-43fa-8662-583dcd2239fe tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1515 microversion: 2.1 time: 0.184001 Jun 24 08:42:44.386657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 156/310] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:44 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:44.982836 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:44.983436 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] [instance: 26097941-773c-4dbc-b99b-b0dfd3ed781f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:44.990042 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.990482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:44.991231 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.991659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:45.006382 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] HTTP exception thrown: Instance 26097941-773c-4dbc-b99b-b0dfd3ed781f could not be found. Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Request method failure captured: Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f HTTP/1.1 Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXi8--NC_sVizE7XUrIm6bvntC9AubeBejHnNI_pySQscCnUcbsX3n8bvWLTn8ofI8Cuphd-ql4cGFxsjGNZWds_GIzrc_IPe-SgUrE9BTALV3qbb2TsxeLmUc7d7A36WLi-xtq3N8c_Czy402si6wg3_sf_0v8KErmZAMNryUG98lE Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 91137dbd48fe4e6d986c350c8435bbab Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesActionsTest-702737125 Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:42:45.008582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/91137dbd48fe4e6d986c350c8435bbab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/91137dbd48fe4e6d986c350c8435bbab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/91137dbd48fe4e6d986c350c8435bbab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_91137dbd48fe4e6d986c350c8435bbab", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesActionsTest-702737125 Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 91137dbd48fe4e6d986c350c8435bbab Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesActionsTest-702737125 Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesActionsTest-702737125-project Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 740d843e5abb439b954996aaf841ed63 Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesActionsTest-702737125-project Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 26097941-773c-4dbc-b99b-b0dfd3ed781f could not be found. Jun 24 08:42:45.010116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '26097941-773c-4dbc-b99b-b0dfd3ed781f'} Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26097941-773c-4dbc-b99b-b0dfd3ed781f could not be found. Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:45.010965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26097941-773c-4dbc-b99b-b0dfd3ed781f could not be found. Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26097941-773c-4dbc-b99b-b0dfd3ed781f could not be found. Jun 24 08:42:45.012030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:42:45.013014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] Returning 404 to user: Instance 26097941-773c-4dbc-b99b-b0dfd3ed781f could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:45.013014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-10b7c651-3dc3-496d-b0b6-57909d40257c tempest-VolumesActionsTest-702737125 tempest-VolumesActionsTest-702737125-project] 10.222.0.13 "GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f" status: 404 len: 111 microversion: 2.1 time: 0.031290 Jun 24 08:42:45.013014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 155/311] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:44 2022] GET /compute/v2.1/servers/26097941-773c-4dbc-b99b-b0dfd3ed781f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:45.793330 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2d76540f-604d-42a3-875c-236c8f9c41ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:45.795065 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2d76540f-604d-42a3-875c-236c8f9c41ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:45.802878 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d76540f-604d-42a3-875c-236c8f9c41ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:45.803554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d76540f-604d-42a3-875c-236c8f9c41ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:45.804610 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d76540f-604d-42a3-875c-236c8f9c41ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:45.805292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d76540f-604d-42a3-875c-236c8f9c41ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:45.835225 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-2d76540f-604d-42a3-875c-236c8f9c41ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lazy-loading 'flavor' on Instance uuid 01ede17c-58db-4ce0-a48f-de711078fbee {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:42:45.940187 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2d76540f-604d-42a3-875c-236c8f9c41ed tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee/action" status: 200 len: 32 microversion: 2.1 time: 0.152170 Jun 24 08:42:45.941124 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 157/312] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:42:45 2022] POST /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:42:45.951002 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-580254e5-0002-46bc-93d7-c5bc3d35a31f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:45.952476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-580254e5-0002-46bc-93d7-c5bc3d35a31f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:45.960488 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-580254e5-0002-46bc-93d7-c5bc3d35a31f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:45.961107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-580254e5-0002-46bc-93d7-c5bc3d35a31f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:45.962139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-580254e5-0002-46bc-93d7-c5bc3d35a31f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:45.962798 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-580254e5-0002-46bc-93d7-c5bc3d35a31f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:46.187226 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-580254e5-0002-46bc-93d7-c5bc3d35a31f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:46.195560 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-580254e5-0002-46bc-93d7-c5bc3d35a31f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.248279 Jun 24 08:42:46.196140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 156/313] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:45 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:47.215065 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0af3b8d3-9f64-489f-b80e-b6ce0b167972 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:47.216456 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0af3b8d3-9f64-489f-b80e-b6ce0b167972 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:47.223546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0af3b8d3-9f64-489f-b80e-b6ce0b167972 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:47.224345 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0af3b8d3-9f64-489f-b80e-b6ce0b167972 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:47.225363 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0af3b8d3-9f64-489f-b80e-b6ce0b167972 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:47.225930 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0af3b8d3-9f64-489f-b80e-b6ce0b167972 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:47.432046 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0af3b8d3-9f64-489f-b80e-b6ce0b167972 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:47.442103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0af3b8d3-9f64-489f-b80e-b6ce0b167972 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.232451 Jun 24 08:42:47.442887 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 158/314] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:47 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:48.461235 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a208e672-201f-480f-8858-b42eaf04e10b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:48.462873 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a208e672-201f-480f-8858-b42eaf04e10b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:48.474127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a208e672-201f-480f-8858-b42eaf04e10b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:48.474699 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a208e672-201f-480f-8858-b42eaf04e10b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:48.475866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a208e672-201f-480f-8858-b42eaf04e10b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:48.476592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a208e672-201f-480f-8858-b42eaf04e10b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:48.729379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a208e672-201f-480f-8858-b42eaf04e10b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:48.746334 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a208e672-201f-480f-8858-b42eaf04e10b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.289610 Jun 24 08:42:48.761821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 157/315] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:48 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:49.773386 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-232033c8-dd83-4dfa-b505-443a0ed69bc7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:49.774044 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-232033c8-dd83-4dfa-b505-443a0ed69bc7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:49.792205 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-232033c8-dd83-4dfa-b505-443a0ed69bc7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:49.792658 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-232033c8-dd83-4dfa-b505-443a0ed69bc7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:49.793568 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-232033c8-dd83-4dfa-b505-443a0ed69bc7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:49.794040 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-232033c8-dd83-4dfa-b505-443a0ed69bc7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:50.066522 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-232033c8-dd83-4dfa-b505-443a0ed69bc7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:50.077233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-232033c8-dd83-4dfa-b505-443a0ed69bc7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.307685 Jun 24 08:42:50.078383 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 159/316] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:49 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:51.011386 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cbee1220-515a-4b85-aa66-4dcdb9079715 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:51.027136 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cbee1220-515a-4b85-aa66-4dcdb9079715 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.027883 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cbee1220-515a-4b85-aa66-4dcdb9079715 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.098234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aa61e5d6-cdb6-4b64-890e-d797c7902191 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:51.099044 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-aa61e5d6-cdb6-4b64-890e-d797c7902191 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:51.111855 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa61e5d6-cdb6-4b64-890e-d797c7902191 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.112888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa61e5d6-cdb6-4b64-890e-d797c7902191 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.115700 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa61e5d6-cdb6-4b64-890e-d797c7902191 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.117271 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa61e5d6-cdb6-4b64-890e-d797c7902191 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.188100 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cbee1220-515a-4b85-aa66-4dcdb9079715 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Going to try to stop instance {{(pid=124380) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 08:42:51.276245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cbee1220-515a-4b85-aa66-4dcdb9079715 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/action" status: 202 len: 0 microversion: 2.1 time: 0.269886 Jun 24 08:42:51.279794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 158/317] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:42:51 2022] POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:42:51.318717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b16d2894-356f-4dfe-9b0c-0086230c183b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:51.325763 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b16d2894-356f-4dfe-9b0c-0086230c183b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:51.336211 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b16d2894-356f-4dfe-9b0c-0086230c183b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.336858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b16d2894-356f-4dfe-9b0c-0086230c183b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.338026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b16d2894-356f-4dfe-9b0c-0086230c183b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.338612 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b16d2894-356f-4dfe-9b0c-0086230c183b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.565709 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aa61e5d6-cdb6-4b64-890e-d797c7902191 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:51.579750 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aa61e5d6-cdb6-4b64-890e-d797c7902191 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.487473 Jun 24 08:42:51.580770 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 160/318] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:51 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:51.686651 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b16d2894-356f-4dfe-9b0c-0086230c183b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:51.698606 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b16d2894-356f-4dfe-9b0c-0086230c183b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.403098 Jun 24 08:42:51.699217 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 159/319] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:51 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:52.607727 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c6c9f602-7572-4525-abfa-81cdcbe7e7c9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:52.609098 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c6c9f602-7572-4525-abfa-81cdcbe7e7c9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:52.631651 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6c9f602-7572-4525-abfa-81cdcbe7e7c9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:52.632523 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6c9f602-7572-4525-abfa-81cdcbe7e7c9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:52.633483 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6c9f602-7572-4525-abfa-81cdcbe7e7c9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:52.634104 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6c9f602-7572-4525-abfa-81cdcbe7e7c9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:52.723947 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-451ba919-4afa-4ef1-934e-9db8cabeb411 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:52.724740 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-451ba919-4afa-4ef1-934e-9db8cabeb411 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:52.746201 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-451ba919-4afa-4ef1-934e-9db8cabeb411 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:52.746782 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-451ba919-4afa-4ef1-934e-9db8cabeb411 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:52.748105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-451ba919-4afa-4ef1-934e-9db8cabeb411 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:52.749094 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-451ba919-4afa-4ef1-934e-9db8cabeb411 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:53.253725 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-451ba919-4afa-4ef1-934e-9db8cabeb411 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:53.265911 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-451ba919-4afa-4ef1-934e-9db8cabeb411 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.548021 Jun 24 08:42:53.278725 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 160/320] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:52 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:53.351182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c6c9f602-7572-4525-abfa-81cdcbe7e7c9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:53.369062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c6c9f602-7572-4525-abfa-81cdcbe7e7c9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.765400 Jun 24 08:42:53.373744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 161/321] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:52 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:54.286685 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0c496513-f85a-4565-9b96-5a286bae4572 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:54.288674 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0c496513-f85a-4565-9b96-5a286bae4572 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:54.306797 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=48 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:54.311719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c496513-f85a-4565-9b96-5a286bae4572 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.312192 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c496513-f85a-4565-9b96-5a286bae4572 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.313054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c496513-f85a-4565-9b96-5a286bae4572 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.313882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c496513-f85a-4565-9b96-5a286bae4572 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.393507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-92f58519-9766-4ce8-9e36-79dcaa09c535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:54.395708 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-92f58519-9766-4ce8-9e36-79dcaa09c535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:54.404578 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92f58519-9766-4ce8-9e36-79dcaa09c535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.405331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92f58519-9766-4ce8-9e36-79dcaa09c535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.406596 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92f58519-9766-4ce8-9e36-79dcaa09c535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.408072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92f58519-9766-4ce8-9e36-79dcaa09c535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.809105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0c496513-f85a-4565-9b96-5a286bae4572 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:54.818528 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0c496513-f85a-4565-9b96-5a286bae4572 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.537318 Jun 24 08:42:54.825359 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-92f58519-9766-4ce8-9e36-79dcaa09c535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:54.829576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 161/322] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:54 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:54.834823 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-92f58519-9766-4ce8-9e36-79dcaa09c535 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.450189 Jun 24 08:42:54.849928 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 162/323] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:54 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:55.851284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9959f375-b0ef-4cfc-989f-ebc9bcbb5477 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:55.852002 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3100acc6-63ee-46d1-ba53-00e443dfcc2a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:55.852395 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9959f375-b0ef-4cfc-989f-ebc9bcbb5477 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:55.852505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3100acc6-63ee-46d1-ba53-00e443dfcc2a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:55.865794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3100acc6-63ee-46d1-ba53-00e443dfcc2a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:55.866267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3100acc6-63ee-46d1-ba53-00e443dfcc2a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:55.869670 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9959f375-b0ef-4cfc-989f-ebc9bcbb5477 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:55.870148 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3100acc6-63ee-46d1-ba53-00e443dfcc2a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:55.870269 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9959f375-b0ef-4cfc-989f-ebc9bcbb5477 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:55.871093 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3100acc6-63ee-46d1-ba53-00e443dfcc2a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:55.871251 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9959f375-b0ef-4cfc-989f-ebc9bcbb5477 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:55.871639 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9959f375-b0ef-4cfc-989f-ebc9bcbb5477 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:56.240304 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9959f375-b0ef-4cfc-989f-ebc9bcbb5477 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:56.286773 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9959f375-b0ef-4cfc-989f-ebc9bcbb5477 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.421876 Jun 24 08:42:56.291495 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 163/324] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:55 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:56.313995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3100acc6-63ee-46d1-ba53-00e443dfcc2a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:56.321549 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5272fb6-fbcf-4362-86cc-fffc4d11a047 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:56.324241 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a5272fb6-fbcf-4362-86cc-fffc4d11a047 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:56.337637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3100acc6-63ee-46d1-ba53-00e443dfcc2a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.491257 Jun 24 08:42:56.354378 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 162/325] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:55 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:56.362825 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5272fb6-fbcf-4362-86cc-fffc4d11a047 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:56.367595 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5272fb6-fbcf-4362-86cc-fffc4d11a047 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:56.368904 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5272fb6-fbcf-4362-86cc-fffc4d11a047 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:56.369552 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5272fb6-fbcf-4362-86cc-fffc4d11a047 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:56.434260 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a5272fb6-fbcf-4362-86cc-fffc4d11a047 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/ips" status: 200 len: 149 microversion: 2.20 time: 0.138902 Jun 24 08:42:56.435226 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 164/326] 10.222.0.13 () {60 vars in 1288 bytes} [Fri Jun 24 08:42:56 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/ips => generated 149 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:42:57.332228 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-291d22c0-d87d-4e2c-ad32-a62faa3833d8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:57.332228 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-291d22c0-d87d-4e2c-ad32-a62faa3833d8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:57.357221 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-62188e97-5b58-4fbe-9357-9f0470897c07 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:57.358955 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-62188e97-5b58-4fbe-9357-9f0470897c07 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:57.365305 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-291d22c0-d87d-4e2c-ad32-a62faa3833d8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.368944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-291d22c0-d87d-4e2c-ad32-a62faa3833d8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:57.370594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-291d22c0-d87d-4e2c-ad32-a62faa3833d8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.373115 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62188e97-5b58-4fbe-9357-9f0470897c07 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.377670 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-291d22c0-d87d-4e2c-ad32-a62faa3833d8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:57.384756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62188e97-5b58-4fbe-9357-9f0470897c07 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:57.386268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62188e97-5b58-4fbe-9357-9f0470897c07 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.394546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62188e97-5b58-4fbe-9357-9f0470897c07 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:58.089998 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-62188e97-5b58-4fbe-9357-9f0470897c07 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:58.114250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-62188e97-5b58-4fbe-9357-9f0470897c07 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.761514 Jun 24 08:42:58.115987 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-291d22c0-d87d-4e2c-ad32-a62faa3833d8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:58.118501 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 165/327] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:57 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:58.128244 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-291d22c0-d87d-4e2c-ad32-a62faa3833d8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.802853 Jun 24 08:42:58.131862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 163/328] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:57 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:59.135084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-db7b5222-b6c7-41c4-ac9e-4ad2499b2e59 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:59.136390 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-db7b5222-b6c7-41c4-ac9e-4ad2499b2e59 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:59.146880 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-899e2a60-78e1-4875-96a6-863a6554e0b7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:59.148621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-899e2a60-78e1-4875-96a6-863a6554e0b7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:59.163469 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-db7b5222-b6c7-41c4-ac9e-4ad2499b2e59 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.164198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-db7b5222-b6c7-41c4-ac9e-4ad2499b2e59 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.166694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-db7b5222-b6c7-41c4-ac9e-4ad2499b2e59 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.167039 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-899e2a60-78e1-4875-96a6-863a6554e0b7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.170475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-db7b5222-b6c7-41c4-ac9e-4ad2499b2e59 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.170983 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-899e2a60-78e1-4875-96a6-863a6554e0b7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.173033 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-899e2a60-78e1-4875-96a6-863a6554e0b7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.174096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-899e2a60-78e1-4875-96a6-863a6554e0b7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.645949 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-db7b5222-b6c7-41c4-ac9e-4ad2499b2e59 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:59.650068 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:59.666937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-db7b5222-b6c7-41c4-ac9e-4ad2499b2e59 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.535582 Jun 24 08:42:59.669580 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 166/329] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:59 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:59.685266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-57362c54-8549-4967-8705-2f318db2a04b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:59.687628 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-57362c54-8549-4967-8705-2f318db2a04b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:59.695629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-899e2a60-78e1-4875-96a6-863a6554e0b7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:59.704429 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-899e2a60-78e1-4875-96a6-863a6554e0b7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.562613 Jun 24 08:42:59.720671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 164/330] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:59 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:59.724226 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-57362c54-8549-4967-8705-2f318db2a04b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.725131 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-57362c54-8549-4967-8705-2f318db2a04b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.727477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-57362c54-8549-4967-8705-2f318db2a04b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.728158 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-57362c54-8549-4967-8705-2f318db2a04b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.780820 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-57362c54-8549-4967-8705-2f318db2a04b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lazy-loading 'flavor' on Instance uuid 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:43:00.431949 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-57362c54-8549-4967-8705-2f318db2a04b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/action" status: 202 len: 0 microversion: 2.20 time: 0.758507 Jun 24 08:43:00.441952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 167/331] 10.222.0.13 () {62 vars in 1318 bytes} [Fri Jun 24 08:42:59 2022] POST /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:43:00.451381 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:00.452110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:00.463424 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.476640 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.478835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.489843 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.688000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4a51c333-ff15-4004-89eb-51522673681a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:00.688965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4a51c333-ff15-4004-89eb-51522673681a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:00.704894 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a51c333-ff15-4004-89eb-51522673681a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.709310 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a51c333-ff15-4004-89eb-51522673681a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.710546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a51c333-ff15-4004-89eb-51522673681a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.712963 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a51c333-ff15-4004-89eb-51522673681a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.738833 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:00.748692 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:00.762553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:00.769781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cbbcc496-b292-4bf6-8a18-549d73e14d94 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.332241 Jun 24 08:43:00.773285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 165/332] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:00 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:00.779437 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f57fb872-e1de-4a97-a1bc-4cead0e3503f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:00.780305 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f57fb872-e1de-4a97-a1bc-4cead0e3503f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:00.789276 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f57fb872-e1de-4a97-a1bc-4cead0e3503f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.790231 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f57fb872-e1de-4a97-a1bc-4cead0e3503f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.791223 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f57fb872-e1de-4a97-a1bc-4cead0e3503f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.791901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f57fb872-e1de-4a97-a1bc-4cead0e3503f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.815565 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:01.090270 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4a51c333-ff15-4004-89eb-51522673681a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:01.101629 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4a51c333-ff15-4004-89eb-51522673681a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.418027 Jun 24 08:43:01.105185 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 168/333] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:00 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:01.156156 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f57fb872-e1de-4a97-a1bc-4cead0e3503f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:01.166868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f57fb872-e1de-4a97-a1bc-4cead0e3503f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.391304 Jun 24 08:43:01.180965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 166/334] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:00 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:01.796441 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:01.798203 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:01.822277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.835359 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:01.836503 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.837173 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.128127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a71e6690-dd52-45eb-85a7-c95256d5c0f5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:02.129345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a71e6690-dd52-45eb-85a7-c95256d5c0f5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:02.138272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a71e6690-dd52-45eb-85a7-c95256d5c0f5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:02.139007 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a71e6690-dd52-45eb-85a7-c95256d5c0f5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.139947 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a71e6690-dd52-45eb-85a7-c95256d5c0f5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:02.142578 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a71e6690-dd52-45eb-85a7-c95256d5c0f5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.474829 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.495553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.499925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.503258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f05c7b0c-ffbc-457d-9d09-56e590feb372 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.712770 Jun 24 08:43:02.507207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 169/335] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:01 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:02.521360 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d66ca140-89df-405e-bef6-8255e365c85d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:02.522956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d66ca140-89df-405e-bef6-8255e365c85d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:02.542285 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d66ca140-89df-405e-bef6-8255e365c85d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:02.545369 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d66ca140-89df-405e-bef6-8255e365c85d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.548734 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d66ca140-89df-405e-bef6-8255e365c85d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:02.550233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d66ca140-89df-405e-bef6-8255e365c85d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.831056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a71e6690-dd52-45eb-85a7-c95256d5c0f5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.853041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a71e6690-dd52-45eb-85a7-c95256d5c0f5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.728268 Jun 24 08:43:02.853668 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 167/336] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:02 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:02.881638 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d66ca140-89df-405e-bef6-8255e365c85d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.890337 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d66ca140-89df-405e-bef6-8255e365c85d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.380393 Jun 24 08:43:02.902743 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 170/337] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:02 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:03.548805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:03.550122 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:03.557815 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.558628 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.559600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.560197 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.887458 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-551d3772-5279-4b31-8842-f56b92dcc67f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:03.887458 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-551d3772-5279-4b31-8842-f56b92dcc67f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:03.888054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:03.906269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:03.913301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:03.916046 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e0631836-fc7a-4db1-b5a6-2556591f4a70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.372012 Jun 24 08:43:03.917118 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 168/338] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:03 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:03.920850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-551d3772-5279-4b31-8842-f56b92dcc67f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.921655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-551d3772-5279-4b31-8842-f56b92dcc67f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.923708 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6b004c86-de01-429d-a0d6-b6ad2ca69d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:03.924781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6b004c86-de01-429d-a0d6-b6ad2ca69d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:03.926451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-551d3772-5279-4b31-8842-f56b92dcc67f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.927042 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-551d3772-5279-4b31-8842-f56b92dcc67f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.932188 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b004c86-de01-429d-a0d6-b6ad2ca69d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.932792 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b004c86-de01-429d-a0d6-b6ad2ca69d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.933759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b004c86-de01-429d-a0d6-b6ad2ca69d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.934312 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b004c86-de01-429d-a0d6-b6ad2ca69d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:04.543511 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6b004c86-de01-429d-a0d6-b6ad2ca69d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:04.570556 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6b004c86-de01-429d-a0d6-b6ad2ca69d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.640537 Jun 24 08:43:04.577335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 169/339] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:03 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:04.621436 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-551d3772-5279-4b31-8842-f56b92dcc67f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:04.640446 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-551d3772-5279-4b31-8842-f56b92dcc67f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.771295 Jun 24 08:43:04.641852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 171/340] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:03 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:04.937451 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:04.938122 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:04.967900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:04.970881 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:04.972638 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:04.975455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.415760 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:05.428406 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:05.429975 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:05.431199 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b2bcba6e-bd1a-4bfd-a04f-29451c88ed79 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.498365 Jun 24 08:43:05.446332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 170/341] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:04 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:05.595781 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f1181ee9-0ae6-4c88-8673-305749def23c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:05.596926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f1181ee9-0ae6-4c88-8673-305749def23c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:05.631169 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1181ee9-0ae6-4c88-8673-305749def23c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:05.631872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1181ee9-0ae6-4c88-8673-305749def23c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.641994 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1181ee9-0ae6-4c88-8673-305749def23c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:05.651376 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1181ee9-0ae6-4c88-8673-305749def23c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.664234 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-378f0e26-44b0-4d61-8009-645910949399 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:05.666150 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-378f0e26-44b0-4d61-8009-645910949399 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:05.697805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-378f0e26-44b0-4d61-8009-645910949399 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:05.702211 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-378f0e26-44b0-4d61-8009-645910949399 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.706183 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-378f0e26-44b0-4d61-8009-645910949399 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:05.711365 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-378f0e26-44b0-4d61-8009-645910949399 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.420847 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-378f0e26-44b0-4d61-8009-645910949399 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.439434 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-378f0e26-44b0-4d61-8009-645910949399 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1723 microversion: 2.1 time: 0.780056 Jun 24 08:43:06.440347 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 171/342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:05 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1723 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:06.455894 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f1181ee9-0ae6-4c88-8673-305749def23c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.472862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:06.473827 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f1181ee9-0ae6-4c88-8673-305749def23c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.882635 Jun 24 08:43:06.474468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 172/343] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:05 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:06.475448 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:06.498335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.502545 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.505716 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.506518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.732242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.749558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.752822 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.754478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1afd53ef-3571-447c-8111-4901876ccb96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.308359 Jun 24 08:43:06.755379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 172/344] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:06 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:06.833813 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e06732cf-6e19-44a5-903b-b9996ba42b6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Action: 'create', calling method: .version_select at 0x7f0a7c096ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-825893973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhfEIEgE+gdm+30jL9FtNsaDYWDMY7Xwp7k8Ammbd0IPNqeEBEkQZLzptuilwA0VIE+WdaIDwldVoY3/UBQFyIPRyplGASz7fZXQpEkl+WcqYANOVMGH7MUPuohm2zoOQ=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:06.872623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-e06732cf-6e19-44a5-903b-b9996ba42b6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Getting quotas for project d0b95979aebe47bc92c387de59394942. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:06.883247 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-e06732cf-6e19-44a5-903b-b9996ba42b6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Getting quotas for user bf905723382e4372ae63d77a376982ff and project d0b95979aebe47bc92c387de59394942. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:06.924996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e06732cf-6e19-44a5-903b-b9996ba42b6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.434209 Jun 24 08:43:06.927158 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 173/345] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:43:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:07.465366 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-01b47a15-b0a8-4c07-9f4e-292fac0c6ac7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:07.466345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-01b47a15-b0a8-4c07-9f4e-292fac0c6ac7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:07.480114 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b47a15-b0a8-4c07-9f4e-292fac0c6ac7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.481302 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b47a15-b0a8-4c07-9f4e-292fac0c6ac7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.482492 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b47a15-b0a8-4c07-9f4e-292fac0c6ac7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.483594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b47a15-b0a8-4c07-9f4e-292fac0c6ac7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.494836 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-28e77bb6-b969-4909-a93b-f6d09096b330 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:07.495903 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-28e77bb6-b969-4909-a93b-f6d09096b330 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:07.514756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28e77bb6-b969-4909-a93b-f6d09096b330 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.517842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28e77bb6-b969-4909-a93b-f6d09096b330 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.520754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28e77bb6-b969-4909-a93b-f6d09096b330 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.529259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28e77bb6-b969-4909-a93b-f6d09096b330 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.850545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-28e77bb6-b969-4909-a93b-f6d09096b330 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:07.851704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-01b47a15-b0a8-4c07-9f4e-292fac0c6ac7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:07.868902 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-28e77bb6-b969-4909-a93b-f6d09096b330 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.380917 Jun 24 08:43:07.872642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-01b47a15-b0a8-4c07-9f4e-292fac0c6ac7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1700 microversion: 2.1 time: 0.419366 Jun 24 08:43:07.873783 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 174/346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:07 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:07.877376 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 173/347] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:07 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1700 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:07.914103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-927aefde-47bf-4444-a76b-a75ff4879842 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:07.914373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:07.914373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:07.926920 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-927aefde-47bf-4444-a76b-a75ff4879842 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.928151 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.928795 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.929459 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-927aefde-47bf-4444-a76b-a75ff4879842 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.930473 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.933458 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.993282 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-927aefde-47bf-4444-a76b-a75ff4879842 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Going to try to start instance {{(pid=124380) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 08:43:08.078873 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-927aefde-47bf-4444-a76b-a75ff4879842 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/action" status: 202 len: 0 microversion: 2.1 time: 0.188926 Jun 24 08:43:08.081963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 174/348] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:43:07 2022] POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:43:08.094725 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-18a21bf8-e507-44a0-aedc-c522d4a1248e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:08.096230 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-18a21bf8-e507-44a0-aedc-c522d4a1248e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:08.117997 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18a21bf8-e507-44a0-aedc-c522d4a1248e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.120882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18a21bf8-e507-44a0-aedc-c522d4a1248e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:08.121725 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18a21bf8-e507-44a0-aedc-c522d4a1248e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.122174 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18a21bf8-e507-44a0-aedc-c522d4a1248e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:08.489951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:08.513625 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:08.520087 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:08.521617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bd185d39-cfc6-449d-996d-3bb00b1c4264 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.645787 Jun 24 08:43:08.523845 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 175/349] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:07 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:08.591056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-18a21bf8-e507-44a0-aedc-c522d4a1248e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:08.618536 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-18a21bf8-e507-44a0-aedc-c522d4a1248e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1709 microversion: 2.1 time: 0.527930 Jun 24 08:43:08.619130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 175/350] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:08 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1709 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:08.889346 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b23c2413-a5d0-4380-8ea9-7a21db15c24c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:08.890121 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b23c2413-a5d0-4380-8ea9-7a21db15c24c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:08.908992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b23c2413-a5d0-4380-8ea9-7a21db15c24c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.909483 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b23c2413-a5d0-4380-8ea9-7a21db15c24c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:08.913381 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b23c2413-a5d0-4380-8ea9-7a21db15c24c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.914356 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b23c2413-a5d0-4380-8ea9-7a21db15c24c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.430766 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b23c2413-a5d0-4380-8ea9-7a21db15c24c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:09.443109 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b23c2413-a5d0-4380-8ea9-7a21db15c24c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.558362 Jun 24 08:43:09.459077 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 176/351] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:08 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:09.541083 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:09.541757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:09.566887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:09.569684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.573841 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:09.576936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.638327 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fc6497e4-702d-431e-aa87-40c302597a90 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:09.639492 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fc6497e4-702d-431e-aa87-40c302597a90 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:09.649764 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:09.655147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fc6497e4-702d-431e-aa87-40c302597a90 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:09.657278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fc6497e4-702d-431e-aa87-40c302597a90 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.659497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fc6497e4-702d-431e-aa87-40c302597a90 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:09.662495 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fc6497e4-702d-431e-aa87-40c302597a90 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.419409 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:10.434411 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:10.438345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:10.443464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a88acfe8-210b-4b16-a0d1-b11df978d21b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.902982 Jun 24 08:43:10.444582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 176/352] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:09 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:10.463012 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a15f68f5-916f-4649-9bb6-beb73f0e4c1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:10.463624 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a15f68f5-916f-4649-9bb6-beb73f0e4c1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:10.476975 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a15f68f5-916f-4649-9bb6-beb73f0e4c1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.477830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a15f68f5-916f-4649-9bb6-beb73f0e4c1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.478829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a15f68f5-916f-4649-9bb6-beb73f0e4c1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.480664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a15f68f5-916f-4649-9bb6-beb73f0e4c1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.519337 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fc6497e4-702d-431e-aa87-40c302597a90 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:10.538111 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fc6497e4-702d-431e-aa87-40c302597a90 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1709 microversion: 2.1 time: 0.904751 Jun 24 08:43:10.542121 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 177/353] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:09 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1709 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:10.943090 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a15f68f5-916f-4649-9bb6-beb73f0e4c1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:10.979460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a15f68f5-916f-4649-9bb6-beb73f0e4c1c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.521088 Jun 24 08:43:10.993271 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 177/354] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:10 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:11.464113 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:11.465032 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:11.487169 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:11.487825 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:11.490718 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:11.492617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:11.560233 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-148f38c1-5d13-47a7-9a06-2cdd819e4e11 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:11.561046 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-148f38c1-5d13-47a7-9a06-2cdd819e4e11 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:11.583674 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-148f38c1-5d13-47a7-9a06-2cdd819e4e11 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:11.590657 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-148f38c1-5d13-47a7-9a06-2cdd819e4e11 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:11.597830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-148f38c1-5d13-47a7-9a06-2cdd819e4e11 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:11.598361 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-148f38c1-5d13-47a7-9a06-2cdd819e4e11 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:11.928180 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-148f38c1-5d13-47a7-9a06-2cdd819e4e11 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:11.944361 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-148f38c1-5d13-47a7-9a06-2cdd819e4e11 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1713 microversion: 2.1 time: 0.388618 Jun 24 08:43:11.948719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 178/355] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:11 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1713 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:12.011477 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2d68b0c8-a094-4f11-9b27-d4772f95db64 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:12.012155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2d68b0c8-a094-4f11-9b27-d4772f95db64 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:12.028595 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d68b0c8-a094-4f11-9b27-d4772f95db64 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.029072 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d68b0c8-a094-4f11-9b27-d4772f95db64 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.030015 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d68b0c8-a094-4f11-9b27-d4772f95db64 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.030824 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d68b0c8-a094-4f11-9b27-d4772f95db64 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.190744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:12.205043 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:12.209449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:12.212920 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b239d145-70f1-4377-9471-1831fcbd6e51 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.753552 Jun 24 08:43:12.231933 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 178/356] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:11 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:12.428379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d68b0c8-a094-4f11-9b27-d4772f95db64 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:12.436592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2d68b0c8-a094-4f11-9b27-d4772f95db64 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.430042 Jun 24 08:43:12.439553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 179/357] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:12 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:13.238378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:13.239690 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:13.249981 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.251510 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.253971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.254794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.436302 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:13.447262 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:13.449566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:13.454756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-959dfa0a-61ba-417c-873a-a01a5d2d997f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.220889 Jun 24 08:43:13.456380 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 179/358] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:13 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:43:13.463695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c85a1111-b3b5-40ad-9508-18aefbb1819a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:13.464931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c85a1111-b3b5-40ad-9508-18aefbb1819a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:13.472961 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c85a1111-b3b5-40ad-9508-18aefbb1819a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.473403 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c85a1111-b3b5-40ad-9508-18aefbb1819a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.474215 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c85a1111-b3b5-40ad-9508-18aefbb1819a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.474818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c85a1111-b3b5-40ad-9508-18aefbb1819a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.673349 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c85a1111-b3b5-40ad-9508-18aefbb1819a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:13.684572 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c85a1111-b3b5-40ad-9508-18aefbb1819a tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.228542 Jun 24 08:43:13.695845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 180/359] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:13 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:14.485515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:14.486424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:14.513617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.514298 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.515522 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.517126 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.700001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:14.704525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-00ea6e78-327c-4876-b968-d175021e1127 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:14.705625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-00ea6e78-327c-4876-b968-d175021e1127 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:14.710431 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:14.713530 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:14.715071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f093bb8e-7062-4ee5-bfd2-58266ab67154 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.245562 Jun 24 08:43:14.717290 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00ea6e78-327c-4876-b968-d175021e1127 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.719943 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00ea6e78-327c-4876-b968-d175021e1127 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.720803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00ea6e78-327c-4876-b968-d175021e1127 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.721229 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00ea6e78-327c-4876-b968-d175021e1127 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.727776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 180/360] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:14 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:14.915773 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-00ea6e78-327c-4876-b968-d175021e1127 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:14.920980 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:14.930934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-00ea6e78-327c-4876-b968-d175021e1127 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.231268 Jun 24 08:43:14.932509 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 181/361] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:14 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:15.735037 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:15.735908 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:15.741645 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:15.742118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:15.742870 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:15.743313 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:15.905471 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:15.919822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:15.923293 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:15.925599 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e74d74ec-be41-4daa-8efa-72b0aa54db53 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.194323 Jun 24 08:43:15.927200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 181/362] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:15 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:15.950615 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-082a497c-87b4-4e81-99f6-778b7b5745f1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:15.951342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-082a497c-87b4-4e81-99f6-778b7b5745f1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:15.959039 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-082a497c-87b4-4e81-99f6-778b7b5745f1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:15.959512 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-082a497c-87b4-4e81-99f6-778b7b5745f1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:15.960273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-082a497c-87b4-4e81-99f6-778b7b5745f1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:15.961006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-082a497c-87b4-4e81-99f6-778b7b5745f1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:16.141315 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-082a497c-87b4-4e81-99f6-778b7b5745f1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:16.154145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-082a497c-87b4-4e81-99f6-778b7b5745f1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.207355 Jun 24 08:43:16.155160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 182/363] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:15 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:16.952612 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:16.953222 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:16.955865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:16.961726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:16.962408 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:16.963207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:16.963637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:16.983471 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:17.110405 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:17.120339 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:17.122108 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:17.124332 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-31a0e666-9364-4a7b-83f7-f031af753339 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.175457 Jun 24 08:43:17.135526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 182/364] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:16 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:17.172571 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4b55414b-2cd9-4eb6-a452-b1ae05be59af tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:17.173301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4b55414b-2cd9-4eb6-a452-b1ae05be59af tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:17.179828 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b55414b-2cd9-4eb6-a452-b1ae05be59af tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:17.180294 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b55414b-2cd9-4eb6-a452-b1ae05be59af tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:17.181051 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b55414b-2cd9-4eb6-a452-b1ae05be59af tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:17.181531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b55414b-2cd9-4eb6-a452-b1ae05be59af tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:17.320867 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4b55414b-2cd9-4eb6-a452-b1ae05be59af tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:17.330446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4b55414b-2cd9-4eb6-a452-b1ae05be59af tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.162143 Jun 24 08:43:17.331029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 183/365] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:17 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:18.145123 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:18.146289 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:18.167625 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:18.168076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.169035 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:18.169488 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.332568 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:18.340422 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:18.341973 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:18.343193 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-26b3e6bb-dd1e-4d04-a21e-115987e36abf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.202324 Jun 24 08:43:18.343744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 183/366] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:18 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:18.352229 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ceb006f3-cba4-4f24-bb41-f2cd4a031e44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:18.353405 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ceb006f3-cba4-4f24-bb41-f2cd4a031e44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:18.360726 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ceb006f3-cba4-4f24-bb41-f2cd4a031e44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:18.361277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ceb006f3-cba4-4f24-bb41-f2cd4a031e44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.362068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ceb006f3-cba4-4f24-bb41-f2cd4a031e44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:18.362495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ceb006f3-cba4-4f24-bb41-f2cd4a031e44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.493387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ceb006f3-cba4-4f24-bb41-f2cd4a031e44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:18.502573 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ceb006f3-cba4-4f24-bb41-f2cd4a031e44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.154068 Jun 24 08:43:18.503154 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 184/367] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:18 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:19.362950 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:19.364357 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:19.376626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.378258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.379141 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.379657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.521421 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a8b6cef6-4694-45ab-9b24-56af53558f68 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:19.522132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a8b6cef6-4694-45ab-9b24-56af53558f68 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:19.532933 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a8b6cef6-4694-45ab-9b24-56af53558f68 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.538414 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a8b6cef6-4694-45ab-9b24-56af53558f68 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.539851 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a8b6cef6-4694-45ab-9b24-56af53558f68 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.541433 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a8b6cef6-4694-45ab-9b24-56af53558f68 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.542954 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:19.552689 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:19.554250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:19.555438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8be73af4-843f-4fe1-9776-1a48c8529534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.197092 Jun 24 08:43:19.556061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 184/368] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:19 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:19.693075 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a8b6cef6-4694-45ab-9b24-56af53558f68 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:19.700889 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a8b6cef6-4694-45ab-9b24-56af53558f68 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.183698 Jun 24 08:43:19.701464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 185/369] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:19 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:20.577763 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:20.579209 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:20.586419 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:20.586963 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:20.587824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:20.588347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:20.719853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aa3e5c68-98af-4bde-9dda-e7f58c3bf147 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:20.720479 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aa3e5c68-98af-4bde-9dda-e7f58c3bf147 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:20.727391 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa3e5c68-98af-4bde-9dda-e7f58c3bf147 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:20.728090 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa3e5c68-98af-4bde-9dda-e7f58c3bf147 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:20.729022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa3e5c68-98af-4bde-9dda-e7f58c3bf147 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:20.729621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa3e5c68-98af-4bde-9dda-e7f58c3bf147 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:20.767826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:20.786633 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:20.790462 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:20.793051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f7f9bba1-9dd4-4409-93b2-1c747631580a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.220712 Jun 24 08:43:20.801739 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 185/370] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:20 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:20.936128 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-aa3e5c68-98af-4bde-9dda-e7f58c3bf147 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:20.947096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aa3e5c68-98af-4bde-9dda-e7f58c3bf147 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.230806 Jun 24 08:43:20.947935 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 186/371] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:20 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:21.818886 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:21.820968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:21.829273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:21.830610 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:21.831757 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:21.832401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:21.968435 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-172b4556-43d1-49f8-b577-4e866f2a844b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:21.969355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-172b4556-43d1-49f8-b577-4e866f2a844b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:21.978007 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-172b4556-43d1-49f8-b577-4e866f2a844b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:21.978767 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-172b4556-43d1-49f8-b577-4e866f2a844b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:21.979782 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-172b4556-43d1-49f8-b577-4e866f2a844b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:21.980583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-172b4556-43d1-49f8-b577-4e866f2a844b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:22.050422 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:22.075931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:22.077848 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:22.079896 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cd2ebc22-77e8-4516-8548-bc49d6574642 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1742 microversion: 2.20 time: 0.270450 Jun 24 08:43:22.085760 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 186/372] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:21 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1742 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:22.232208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-172b4556-43d1-49f8-b577-4e866f2a844b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:22.243640 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-172b4556-43d1-49f8-b577-4e866f2a844b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.278975 Jun 24 08:43:22.257843 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 187/373] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:21 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:23.098600 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:23.099201 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:23.106763 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.107278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.108107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.108613 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.252473 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:23.260584 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3c9e29e1-f306-47ce-8a89-545334d4ec6f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:23.261199 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3c9e29e1-f306-47ce-8a89-545334d4ec6f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:23.261371 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:23.263286 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:23.264838 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d45ea2fd-26fc-4124-93eb-63efe80edce1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1742 microversion: 2.20 time: 0.170037 Jun 24 08:43:23.265995 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 187/374] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:23 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:23.277750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c9e29e1-f306-47ce-8a89-545334d4ec6f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.278196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c9e29e1-f306-47ce-8a89-545334d4ec6f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.278970 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c9e29e1-f306-47ce-8a89-545334d4ec6f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.279399 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c9e29e1-f306-47ce-8a89-545334d4ec6f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.428658 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3c9e29e1-f306-47ce-8a89-545334d4ec6f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:23.436378 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3c9e29e1-f306-47ce-8a89-545334d4ec6f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.179729 Jun 24 08:43:23.436944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 188/375] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:23 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:23.936410 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-9a39c1a0-da50-422b-bc1c-c73a764dbd4d req-4a383c90-50e7-4d2a-8d7e-448aadf15b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6c82-2da5-46c9-8757-4fa70bfa79b1", "name": "network-vif-plugged", "status": "completed", "tag": "24b20858-8a37-47d6-98c3-e6bff8bd12c1"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:23.945259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-9a39c1a0-da50-422b-bc1c-c73a764dbd4d req-4a383c90-50e7-4d2a-8d7e-448aadf15b8c service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.945759 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-9a39c1a0-da50-422b-bc1c-c73a764dbd4d req-4a383c90-50e7-4d2a-8d7e-448aadf15b8c service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.958915 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-9a39c1a0-da50-422b-bc1c-c73a764dbd4d req-4a383c90-50e7-4d2a-8d7e-448aadf15b8c service nova] Creating event network-vif-plugged:24b20858-8a37-47d6-98c3-e6bff8bd12c1 for instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 on hv-cinder-84713 Jun 24 08:43:23.963979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-9a39c1a0-da50-422b-bc1c-c73a764dbd4d req-4a383c90-50e7-4d2a-8d7e-448aadf15b8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031210 Jun 24 08:43:23.964570 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 188/376] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:24.283634 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:24.284298 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:24.290855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:24.291432 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.292208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:24.292675 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.430917 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:24.440370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:24.442032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:24.443277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6413fdee-df92-482e-9371-4b3f484f721a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.163871 Jun 24 08:43:24.444266 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 189/377] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:24 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:24.461970 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3c83f464-7607-47f4-bccb-d18a63de2ef4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:24.462753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3c83f464-7607-47f4-bccb-d18a63de2ef4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:24.470242 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3c83f464-7607-47f4-bccb-d18a63de2ef4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:24.470705 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3c83f464-7607-47f4-bccb-d18a63de2ef4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.471465 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3c83f464-7607-47f4-bccb-d18a63de2ef4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:24.471902 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3c83f464-7607-47f4-bccb-d18a63de2ef4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.621221 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3c83f464-7607-47f4-bccb-d18a63de2ef4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:24.630601 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3c83f464-7607-47f4-bccb-d18a63de2ef4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.180090 Jun 24 08:43:24.631463 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 189/378] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:24 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:25.464432 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:25.465744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:25.468352 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=58 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:25.476393 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.476937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.477744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.478177 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.654343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5ef09f5e-55da-47d2-b278-150142afedbf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:25.655581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5ef09f5e-55da-47d2-b278-150142afedbf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:25.660348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:25.676742 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:25.678279 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:25.679529 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ef09f5e-55da-47d2-b278-150142afedbf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.680168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ef09f5e-55da-47d2-b278-150142afedbf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.681429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ef09f5e-55da-47d2-b278-150142afedbf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.682131 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ef09f5e-55da-47d2-b278-150142afedbf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.686323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e32b08f7-b7b4-4bb9-8c4a-d09f3dfc4e6a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.227481 Jun 24 08:43:25.690142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 190/379] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:25 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:25.837879 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5ef09f5e-55da-47d2-b278-150142afedbf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:25.845868 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5ef09f5e-55da-47d2-b278-150142afedbf tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.200317 Jun 24 08:43:25.856198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 190/380] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:25 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:26.711046 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:26.711820 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:26.720957 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:26.739220 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:26.740420 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:26.740882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:26.863433 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-05b2dce6-3fb6-47e7-9e8a-10c8e41213a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:26.864114 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-05b2dce6-3fb6-47e7-9e8a-10c8e41213a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:26.874248 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05b2dce6-3fb6-47e7-9e8a-10c8e41213a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:26.874702 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05b2dce6-3fb6-47e7-9e8a-10c8e41213a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:26.875543 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05b2dce6-3fb6-47e7-9e8a-10c8e41213a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:26.875977 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05b2dce6-3fb6-47e7-9e8a-10c8e41213a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:26.957157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:26.975514 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:26.977149 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:26.978658 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ca704696-3238-4c89-8b26-8580c60f99bf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.275149 Jun 24 08:43:26.991296 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 191/381] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:26 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:27.125916 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-05b2dce6-3fb6-47e7-9e8a-10c8e41213a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:27.135972 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-05b2dce6-3fb6-47e7-9e8a-10c8e41213a2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.276313 Jun 24 08:43:27.136888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 191/382] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:26 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:28.007454 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:28.009542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:28.019903 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.020646 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.021852 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.022476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.155582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-567b4009-81b9-4348-84ca-22dd34be1838 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:28.157794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-567b4009-81b9-4348-84ca-22dd34be1838 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:28.169059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-567b4009-81b9-4348-84ca-22dd34be1838 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.169778 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-567b4009-81b9-4348-84ca-22dd34be1838 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.170976 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-567b4009-81b9-4348-84ca-22dd34be1838 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.171607 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-567b4009-81b9-4348-84ca-22dd34be1838 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.260438 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:28.274387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:28.276066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:28.277398 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6e6c6f5d-9cb2-4e65-b65b-ad363da2f705 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.282823 Jun 24 08:43:28.286710 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 192/383] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:27 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:28.395277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-567b4009-81b9-4348-84ca-22dd34be1838 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:28.411969 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-567b4009-81b9-4348-84ca-22dd34be1838 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.261174 Jun 24 08:43:28.421286 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 192/384] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:28 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:29.296447 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:29.297572 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:29.304859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:29.306056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.307081 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:29.307790 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.428829 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-14df126f-74df-4c19-92f3-671154cc0677 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:29.429451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-14df126f-74df-4c19-92f3-671154cc0677 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:29.440688 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14df126f-74df-4c19-92f3-671154cc0677 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:29.443871 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14df126f-74df-4c19-92f3-671154cc0677 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.445168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14df126f-74df-4c19-92f3-671154cc0677 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:29.445610 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14df126f-74df-4c19-92f3-671154cc0677 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.523750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:29.537451 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:29.539005 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:29.543792 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d8cc3af4-91bc-4ce1-ac64-cc268ab77272 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.247863 Jun 24 08:43:29.546390 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 193/385] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:29 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:29.691679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14df126f-74df-4c19-92f3-671154cc0677 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:29.705161 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-14df126f-74df-4c19-92f3-671154cc0677 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.277796 Jun 24 08:43:29.716738 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 193/386] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:29 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:30.565599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:30.566912 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:30.581083 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.581961 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.589669 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.590698 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.725386 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-15c78f1b-9d4a-4f1f-982e-949f5c01ec2d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:30.726852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-15c78f1b-9d4a-4f1f-982e-949f5c01ec2d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:30.733182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15c78f1b-9d4a-4f1f-982e-949f5c01ec2d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.733939 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15c78f1b-9d4a-4f1f-982e-949f5c01ec2d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.736133 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15c78f1b-9d4a-4f1f-982e-949f5c01ec2d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.736603 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15c78f1b-9d4a-4f1f-982e-949f5c01ec2d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.886061 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:30.897412 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:30.899464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:30.900922 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-48cf94fa-718c-4382-b821-c1c5988d7d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.339436 Jun 24 08:43:30.901859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 194/387] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:30 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:43:31.093959 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-15c78f1b-9d4a-4f1f-982e-949f5c01ec2d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:31.109222 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-15c78f1b-9d4a-4f1f-982e-949f5c01ec2d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.387501 Jun 24 08:43:31.112315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 194/388] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:30 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:31.920777 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:31.921681 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:31.931903 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:31.932677 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:31.935527 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:31.938704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:32.123084 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:32.128683 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1d7a31d5-a0e0-4193-9876-37cd892476e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:32.129296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1d7a31d5-a0e0-4193-9876-37cd892476e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:32.146276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d7a31d5-a0e0-4193-9876-37cd892476e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:32.149472 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:32.150611 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d7a31d5-a0e0-4193-9876-37cd892476e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:32.151604 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d7a31d5-a0e0-4193-9876-37cd892476e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:32.152308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d7a31d5-a0e0-4193-9876-37cd892476e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:32.155623 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:32.160259 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8cb512a3-a72d-4e86-bbe9-3558c39d66a3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.243501 Jun 24 08:43:32.161923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 195/389] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:31 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:32.468934 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1d7a31d5-a0e0-4193-9876-37cd892476e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:32.482284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1d7a31d5-a0e0-4193-9876-37cd892476e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.357405 Jun 24 08:43:32.482875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 195/390] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:32 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:33.180850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:33.182470 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:33.193390 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:33.194087 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.195030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:33.195853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.427513 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:33.441032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:33.444997 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:33.446729 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7c4ddeea-95ea-432f-941b-ab69cbd37e9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.270899 Jun 24 08:43:33.461097 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 196/391] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:33 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:33.500803 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ef2464c1-3d79-4e4b-9101-8bb75cc1efa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:33.501709 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ef2464c1-3d79-4e4b-9101-8bb75cc1efa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:33.509714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef2464c1-3d79-4e4b-9101-8bb75cc1efa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:33.510458 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef2464c1-3d79-4e4b-9101-8bb75cc1efa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.511464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef2464c1-3d79-4e4b-9101-8bb75cc1efa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:33.524237 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef2464c1-3d79-4e4b-9101-8bb75cc1efa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.735337 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ef2464c1-3d79-4e4b-9101-8bb75cc1efa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:33.743456 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ef2464c1-3d79-4e4b-9101-8bb75cc1efa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.247776 Jun 24 08:43:33.748497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 196/392] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:33 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:34.467117 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:34.467721 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:34.496096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.496571 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.497335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.497801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.669304 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:34.681657 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:34.683323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:34.684602 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fb4bf86a-d129-4508-ad9c-d74f6f284a3a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.221737 Jun 24 08:43:34.685170 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 197/393] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:34 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:43:34.764783 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-49a221dd-9e1a-42d0-817c-11268bd770c8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:34.765333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-49a221dd-9e1a-42d0-817c-11268bd770c8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:34.774250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49a221dd-9e1a-42d0-817c-11268bd770c8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.775010 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49a221dd-9e1a-42d0-817c-11268bd770c8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.775961 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49a221dd-9e1a-42d0-817c-11268bd770c8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.776398 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49a221dd-9e1a-42d0-817c-11268bd770c8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.935801 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-49a221dd-9e1a-42d0-817c-11268bd770c8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:34.946367 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-49a221dd-9e1a-42d0-817c-11268bd770c8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.185782 Jun 24 08:43:34.947514 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 197/394] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:34 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:35.703674 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:35.704480 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:35.723736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:35.724189 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:35.724968 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:35.725402 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:35.755820 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:35.882180 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:35.890120 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:35.892760 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:35.893967 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f53ed99f-8653-4520-bdd7-d4ae37342db1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1737 microversion: 2.20 time: 0.194819 Jun 24 08:43:35.894522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 198/395] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:35 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:35.964416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5b28e264-1987-4c73-847d-59f8989747ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:35.965039 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5b28e264-1987-4c73-847d-59f8989747ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:35.972534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5b28e264-1987-4c73-847d-59f8989747ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:35.972977 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5b28e264-1987-4c73-847d-59f8989747ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:35.973770 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5b28e264-1987-4c73-847d-59f8989747ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:35.974300 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5b28e264-1987-4c73-847d-59f8989747ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.115968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5b28e264-1987-4c73-847d-59f8989747ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:36.123912 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5b28e264-1987-4c73-847d-59f8989747ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1501 microversion: 2.1 time: 0.163195 Jun 24 08:43:36.124480 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 198/396] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:35 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:36.141760 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0903fc1e-c80c-478c-b2b9-f8e0f47f7375"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:36.142820 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:36.149814 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.150597 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.151966 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.152730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.182085 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] HTTP exception thrown: Cannot 'attach_volume' instance 01ede17c-58db-4ce0-a48f-de711078fbee while it is in vm_state rescued Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Request method failure captured: Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: POST /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee/os-volume_attachments HTTP/1.1 Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 74 Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiVits7z_fNY9CIdaVGFwsyyojS1gN_005o09PgebDbafPXTjFtE0sMjdOvU7dXDThXGKu3RBAjPIRw6jmKgz9siH16jgnXL3L5kANDajWkrvFKUibt6kjc2oMQPduH420ivpFFX0X8yRrwy2kU5dysnMtxSK-KhekZ8UMKvyDfK_k Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:43:36.183781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dfa535df5dd14d69bb3ca125cbd9fe13", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 71e0fd73e5c9430c813af1de9ccd4a52 Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {"volumeAttachment": {"volumeId": "0903fc1e-c80c-478c-b2b9-f8e0f47f7375"}} Jun 24 08:43:36.185242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Cannot 'attach_volume' instance 01ede17c-58db-4ce0-a48f-de711078fbee while it is in vm_state rescued Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'server_id': '01ede17c-58db-4ce0-a48f-de711078fbee', 'body': {'volumeAttachment': {'volumeId': '0903fc1e-c80c-478c-b2b9-f8e0f47f7375'}}} Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ede17c-58db-4ce0-a48f-de711078fbee in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:36.186175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 01ede17c-58db-4ce0-a48f-de711078fbee while it is in vm_state rescued Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:36.188132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:36.189591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:36.189591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:36.189591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 01ede17c-58db-4ce0-a48f-de711078fbee while it is in vm_state rescued Jun 24 08:43:36.189591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:36.189591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Returning 409 to user: Cannot 'attach_volume' instance 01ede17c-58db-4ce0-a48f-de711078fbee while it is in vm_state rescued {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:36.189591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c329fc67-b8e0-4886-91ed-a21fc29d9d3c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048368 Jun 24 08:43:36.189591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 199/397] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:43:36 2022] POST /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:43:36.197928 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8cd262c4-c5e9-49e0-ad13-b216cf138865 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:36.198727 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8cd262c4-c5e9-49e0-ad13-b216cf138865 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:36.208461 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8cd262c4-c5e9-49e0-ad13-b216cf138865 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.209184 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8cd262c4-c5e9-49e0-ad13-b216cf138865 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.210357 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8cd262c4-c5e9-49e0-ad13-b216cf138865 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.211012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8cd262c4-c5e9-49e0-ad13-b216cf138865 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.245483 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:36.293779 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8cd262c4-c5e9-49e0-ad13-b216cf138865 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee/action" status: 202 len: 0 microversion: 2.1 time: 0.101812 Jun 24 08:43:36.294402 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 199/398] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:43:36 2022] POST /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:43:36.302646 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-00c782a4-ad75-451c-815e-25fa1187f3a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:36.303262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-00c782a4-ad75-451c-815e-25fa1187f3a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:36.309578 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00c782a4-ad75-451c-815e-25fa1187f3a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.310057 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00c782a4-ad75-451c-815e-25fa1187f3a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.310826 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00c782a4-ad75-451c-815e-25fa1187f3a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.311263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00c782a4-ad75-451c-815e-25fa1187f3a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.447455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-00c782a4-ad75-451c-815e-25fa1187f3a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:36.455545 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-00c782a4-ad75-451c-815e-25fa1187f3a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1509 microversion: 2.1 time: 0.156651 Jun 24 08:43:36.456105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 200/399] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:36 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:36.681776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-30580784", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825893973", "security_groups": [{"name": "tempest-secgroup-smoke-404408504"}], "block_device_mapping_v2": [{"uuid": "247ee42e-9902-4ce2-936f-2f75308a91ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6af235bb-9dd2-419a-b173-c8cd5b4cf745"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:36.799675 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] validate_networks() for [('6af235bb-9dd2-419a-b173-c8cd5b4cf745', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:43:36.913327 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:36.914640 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:36.921452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.922502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.923274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.923830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.159233 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:37.168450 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:37.170197 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:37.172539 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7dd46830-7e9e-47f8-b58d-62c68da98eb2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1719 microversion: 2.20 time: 0.262502 Jun 24 08:43:37.184056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 201/400] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:36 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1719 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:37.283726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:43:37.284293 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:43:37.284603 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:43:37.285012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:43:37.285419 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:43:37.294637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.295119 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.295919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.296361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.314626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Getting quotas for project d0b95979aebe47bc92c387de59394942. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:37.318955 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Getting quotas for user bf905723382e4372ae63d77a376982ff and project d0b95979aebe47bc92c387de59394942. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:37.390182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:43:37.393682 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='247ee42e-9902-4ce2-936f-2f75308a91ae',volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:43:37.475348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6ad5c066-3e38-4010-b5d9-1b47e2e526a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:37.476262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6ad5c066-3e38-4010-b5d9-1b47e2e526a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:37.483052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ad5c066-3e38-4010-b5d9-1b47e2e526a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.483733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ad5c066-3e38-4010-b5d9-1b47e2e526a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.485253 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ad5c066-3e38-4010-b5d9-1b47e2e526a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.486032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ad5c066-3e38-4010-b5d9-1b47e2e526a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.548906 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-691b6b4f-bb27-4365-a312-43df4fc0c563 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.871281 Jun 24 08:43:37.549890 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 200/401] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:43:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:43:37.561992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9050e7dc-459f-47d1-bc35-218e14190a77 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:37.563484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9050e7dc-459f-47d1-bc35-218e14190a77 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:37.644511 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9050e7dc-459f-47d1-bc35-218e14190a77 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:37.655136 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9050e7dc-459f-47d1-bc35-218e14190a77 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1092 microversion: 2.1 time: 0.099041 Jun 24 08:43:37.656257 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 201/402] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:37 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1092 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:37.677006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6ad5c066-3e38-4010-b5d9-1b47e2e526a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:37.685607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6ad5c066-3e38-4010-b5d9-1b47e2e526a3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1509 microversion: 2.1 time: 0.216869 Jun 24 08:43:37.686262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 202/403] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:37 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:38.201318 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:38.201953 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:38.209342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.209815 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:38.210789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.211213 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:38.405412 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:38.415030 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:38.416861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:38.418242 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a3fb0df3-dff0-4eae-8090-339c6e525a1e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1719 microversion: 2.20 time: 0.221082 Jun 24 08:43:38.418850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 202/404] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:38 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1719 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:38.673252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-53200274-2797-46ed-85ec-f1891361b9b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:38.674108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-53200274-2797-46ed-85ec-f1891361b9b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:38.680855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53200274-2797-46ed-85ec-f1891361b9b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.681410 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53200274-2797-46ed-85ec-f1891361b9b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:38.682373 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53200274-2797-46ed-85ec-f1891361b9b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.682868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53200274-2797-46ed-85ec-f1891361b9b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:38.710970 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a8436127-6814-4515-902c-8bf4525540c1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:38.717630 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a8436127-6814-4515-902c-8bf4525540c1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:38.733474 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a8436127-6814-4515-902c-8bf4525540c1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.737324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a8436127-6814-4515-902c-8bf4525540c1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:38.739241 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a8436127-6814-4515-902c-8bf4525540c1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.740111 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a8436127-6814-4515-902c-8bf4525540c1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:39.045467 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-53200274-2797-46ed-85ec-f1891361b9b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:39.061663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-53200274-2797-46ed-85ec-f1891361b9b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1142 microversion: 2.1 time: 0.393061 Jun 24 08:43:39.073125 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 203/405] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:38 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1142 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:39.276284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a8436127-6814-4515-902c-8bf4525540c1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:39.290410 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a8436127-6814-4515-902c-8bf4525540c1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1509 microversion: 2.1 time: 0.590429 Jun 24 08:43:39.291680 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 203/406] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:38 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1509 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:39.440519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:39.441295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:39.447682 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:39.448246 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:39.449141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:39.449665 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:39.629836 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:39.638551 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:39.640999 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:39.642695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ef3295eb-db93-4a9a-89cc-85b7f7978708 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1719 microversion: 2.20 time: 0.206876 Jun 24 08:43:39.643246 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 204/407] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:39 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:43:40.080585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-60060c09-4e9d-4a70-bfdb-c9b860fba6d7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:40.081202 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-60060c09-4e9d-4a70-bfdb-c9b860fba6d7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:40.083201 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:40.088406 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60060c09-4e9d-4a70-bfdb-c9b860fba6d7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.088857 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60060c09-4e9d-4a70-bfdb-c9b860fba6d7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.089613 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60060c09-4e9d-4a70-bfdb-c9b860fba6d7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.090074 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60060c09-4e9d-4a70-bfdb-c9b860fba6d7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.153275 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-60060c09-4e9d-4a70-bfdb-c9b860fba6d7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:40.160895 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-60060c09-4e9d-4a70-bfdb-c9b860fba6d7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1198 microversion: 2.1 time: 0.085396 Jun 24 08:43:40.161748 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 204/408] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:40 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:40.308403 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b124744f-82d5-4fcb-bbf3-0f11a41c67a1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:40.309005 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b124744f-82d5-4fcb-bbf3-0f11a41c67a1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:40.316765 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b124744f-82d5-4fcb-bbf3-0f11a41c67a1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.317287 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b124744f-82d5-4fcb-bbf3-0f11a41c67a1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.318026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b124744f-82d5-4fcb-bbf3-0f11a41c67a1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.318450 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b124744f-82d5-4fcb-bbf3-0f11a41c67a1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.455287 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b124744f-82d5-4fcb-bbf3-0f11a41c67a1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:40.462714 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b124744f-82d5-4fcb-bbf3-0f11a41c67a1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1509 microversion: 2.1 time: 0.158226 Jun 24 08:43:40.463264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 205/409] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:40 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:40.661426 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:40.662068 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:40.668132 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.668574 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.669328 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.669800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.805579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:40.813554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:40.815080 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:40.816251 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-26095ed4-b54e-4247-813c-2022a80e270b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1719 microversion: 2.20 time: 0.158741 Jun 24 08:43:40.816791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 205/410] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:40 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:40.863235 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-880750839", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "networks": [{"uuid": "943a828b-ef50-4d2e-9324-0233b619718b"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:40.913294 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] validate_networks() for [('943a828b-ef50-4d2e-9324-0233b619718b', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:43:41.178718 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2a167b81-772d-4eb3-bb76-11176239caf6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:41.179404 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2a167b81-772d-4eb3-bb76-11176239caf6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:41.185493 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a167b81-772d-4eb3-bb76-11176239caf6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.186059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a167b81-772d-4eb3-bb76-11176239caf6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.186897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a167b81-772d-4eb3-bb76-11176239caf6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.187463 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a167b81-772d-4eb3-bb76-11176239caf6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.276347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2a167b81-772d-4eb3-bb76-11176239caf6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:41.285045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2a167b81-772d-4eb3-bb76-11176239caf6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1198 microversion: 2.1 time: 0.110042 Jun 24 08:43:41.285624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 206/411] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:41 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1198 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:41.293819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:43:41.294313 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:43:41.294900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:43:41.295308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:43:41.295717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:43:41.304733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.305167 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.305995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.306426 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.325370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Getting quotas for project 84c244fc43f94ea2bc9f76965c111e78. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:41.330004 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Getting quotas for user 2039bddb840c4ac784f0b1c52326c79f and project 84c244fc43f94ea2bc9f76965c111e78. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:41.340698 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:43:41.343318 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:43:41.390593 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-367a2fed-18d0-47fe-95c7-465ff5f826e8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531531 Jun 24 08:43:41.391278 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 206/412] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:43:41.401887 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f90acfd9-da28-4460-8cef-300e03112c7e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:41.402681 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f90acfd9-da28-4460-8cef-300e03112c7e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:41.456908 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f90acfd9-da28-4460-8cef-300e03112c7e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:41.463910 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f90acfd9-da28-4460-8cef-300e03112c7e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1218 microversion: 2.1 time: 0.065871 Jun 24 08:43:41.470218 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 207/413] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:41 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:41.479848 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae6b8346-73c7-4a19-943b-306829fd1fa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:41.480586 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ae6b8346-73c7-4a19-943b-306829fd1fa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:41.487734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae6b8346-73c7-4a19-943b-306829fd1fa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.488186 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae6b8346-73c7-4a19-943b-306829fd1fa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.488977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae6b8346-73c7-4a19-943b-306829fd1fa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.489710 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae6b8346-73c7-4a19-943b-306829fd1fa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.646102 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae6b8346-73c7-4a19-943b-306829fd1fa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:41.654822 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ae6b8346-73c7-4a19-943b-306829fd1fa1 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1509 microversion: 2.1 time: 0.178786 Jun 24 08:43:41.655390 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 207/414] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:41 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:41.837155 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:41.837817 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:41.844297 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.844555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.845329 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.845809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.975129 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:41.982971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:41.985540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:41.986737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-87bed74e-f108-4fb2-8cf9-02d5f342bacf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1719 microversion: 2.20 time: 0.153522 Jun 24 08:43:41.987295 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 208/415] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:41 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:42.214625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-61236e82-20c5-4c94-a443-4e8e2177f60e req-2dab11d5-406b-4539-b6e0-b3736d96a2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6c82-2da5-46c9-8757-4fa70bfa79b1", "name": "network-vif-unplugged", "status": "completed", "tag": "24b20858-8a37-47d6-98c3-e6bff8bd12c1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:42.223764 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-61236e82-20c5-4c94-a443-4e8e2177f60e req-2dab11d5-406b-4539-b6e0-b3736d96a2cf service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.224207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-61236e82-20c5-4c94-a443-4e8e2177f60e req-2dab11d5-406b-4539-b6e0-b3736d96a2cf service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.236179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-61236e82-20c5-4c94-a443-4e8e2177f60e req-2dab11d5-406b-4539-b6e0-b3736d96a2cf service nova] Creating event network-vif-unplugged:24b20858-8a37-47d6-98c3-e6bff8bd12c1 for instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 on hv-cinder-84713 Jun 24 08:43:42.241476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-61236e82-20c5-4c94-a443-4e8e2177f60e req-2dab11d5-406b-4539-b6e0-b3736d96a2cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030566 Jun 24 08:43:42.242149 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 208/416] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:42.302371 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fd7dfffa-c793-4bb9-92ca-452308266d39 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:42.302915 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fd7dfffa-c793-4bb9-92ca-452308266d39 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:42.308855 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fd7dfffa-c793-4bb9-92ca-452308266d39 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.309289 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fd7dfffa-c793-4bb9-92ca-452308266d39 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.310076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fd7dfffa-c793-4bb9-92ca-452308266d39 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.310506 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fd7dfffa-c793-4bb9-92ca-452308266d39 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.376461 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fd7dfffa-c793-4bb9-92ca-452308266d39 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:42.383873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fd7dfffa-c793-4bb9-92ca-452308266d39 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1198 microversion: 2.1 time: 0.085483 Jun 24 08:43:42.384426 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 209/417] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:42 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:42.484632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7d7461e4-eb52-4321-abbb-6fcfcb827ebc tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:42.485427 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7d7461e4-eb52-4321-abbb-6fcfcb827ebc tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:42.491627 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d7461e4-eb52-4321-abbb-6fcfcb827ebc tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.492071 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d7461e4-eb52-4321-abbb-6fcfcb827ebc tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.492827 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d7461e4-eb52-4321-abbb-6fcfcb827ebc tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.493269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d7461e4-eb52-4321-abbb-6fcfcb827ebc tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.558175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7d7461e4-eb52-4321-abbb-6fcfcb827ebc tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:42.565763 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7d7461e4-eb52-4321-abbb-6fcfcb827ebc tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1222 microversion: 2.1 time: 0.086565 Jun 24 08:43:42.568709 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 209/418] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:42 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:42.672083 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-09596b15-b6d9-4058-85e9-9ce5d654df23 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:42.672682 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-09596b15-b6d9-4058-85e9-9ce5d654df23 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:42.678949 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09596b15-b6d9-4058-85e9-9ce5d654df23 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.679394 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09596b15-b6d9-4058-85e9-9ce5d654df23 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.680157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09596b15-b6d9-4058-85e9-9ce5d654df23 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.680592 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09596b15-b6d9-4058-85e9-9ce5d654df23 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.806567 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-09596b15-b6d9-4058-85e9-9ce5d654df23 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:42.814229 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-09596b15-b6d9-4058-85e9-9ce5d654df23 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1509 microversion: 2.1 time: 0.146053 Jun 24 08:43:42.814833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 210/419] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:42 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:43.005871 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:43.006529 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:43.013709 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.014146 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.014896 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.016265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.148437 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:43.156793 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:43.158525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:43.159710 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c261805c-5832-4bf8-b381-c21f2133c1af tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1719 microversion: 2.20 time: 0.158059 Jun 24 08:43:43.160452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 210/420] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:43 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:43.406243 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a977ea25-8fed-408e-9772-aebb8b1b7bbe tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:43.409806 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a977ea25-8fed-408e-9772-aebb8b1b7bbe tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:43.426372 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a977ea25-8fed-408e-9772-aebb8b1b7bbe tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.426819 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a977ea25-8fed-408e-9772-aebb8b1b7bbe tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.427623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a977ea25-8fed-408e-9772-aebb8b1b7bbe tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.436012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a977ea25-8fed-408e-9772-aebb8b1b7bbe tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.557720 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a977ea25-8fed-408e-9772-aebb8b1b7bbe tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:43.568065 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a977ea25-8fed-408e-9772-aebb8b1b7bbe tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1208 microversion: 2.1 time: 0.169372 Jun 24 08:43:43.570575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 211/421] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:43 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1208 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:43.584329 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-50a43622-ab31-4f3a-b835-db73b237c22a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:43.584929 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-50a43622-ab31-4f3a-b835-db73b237c22a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:43.593829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50a43622-ab31-4f3a-b835-db73b237c22a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.594513 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50a43622-ab31-4f3a-b835-db73b237c22a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.595737 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50a43622-ab31-4f3a-b835-db73b237c22a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.596326 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50a43622-ab31-4f3a-b835-db73b237c22a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.742221 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-50a43622-ab31-4f3a-b835-db73b237c22a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:43.752127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-50a43622-ab31-4f3a-b835-db73b237c22a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1214 microversion: 2.1 time: 0.171555 Jun 24 08:43:43.764776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 211/422] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:43 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:43.833582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3f47997a-75cd-4eb9-bdfe-79dfc3bacf74 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:43.834187 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3f47997a-75cd-4eb9-bdfe-79dfc3bacf74 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:43.841093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f47997a-75cd-4eb9-bdfe-79dfc3bacf74 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.841866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f47997a-75cd-4eb9-bdfe-79dfc3bacf74 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.843970 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f47997a-75cd-4eb9-bdfe-79dfc3bacf74 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.844571 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f47997a-75cd-4eb9-bdfe-79dfc3bacf74 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.074719 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3f47997a-75cd-4eb9-bdfe-79dfc3bacf74 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:44.083257 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3f47997a-75cd-4eb9-bdfe-79dfc3bacf74 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1509 microversion: 2.1 time: 0.254314 Jun 24 08:43:44.084107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 212/423] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:43 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:44.180057 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.180690 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:44.187638 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.188409 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.189653 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.190357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.408113 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:44.416134 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:44.417645 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:44.418842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f6565b04-a824-4419-9cdd-f0bd1949be65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1722 microversion: 2.20 time: 0.244157 Jun 24 08:43:44.419414 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 212/424] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:44 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:44.436851 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d6329b6d-f954-4d55-a8aa-2b68d721b5a1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90b46f87-19e9-4a44-a3f8-003cb19f5eab"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:44.439313 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d6329b6d-f954-4d55-a8aa-2b68d721b5a1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:44.445526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6329b6d-f954-4d55-a8aa-2b68d721b5a1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.445996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6329b6d-f954-4d55-a8aa-2b68d721b5a1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.446755 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6329b6d-f954-4d55-a8aa-2b68d721b5a1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.447186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6329b6d-f954-4d55-a8aa-2b68d721b5a1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.585828 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-64b0cdea-a2cd-4f88-aed8-d54fa2ae0c93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.586566 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-64b0cdea-a2cd-4f88-aed8-d54fa2ae0c93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:44.593583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64b0cdea-a2cd-4f88-aed8-d54fa2ae0c93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.594044 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64b0cdea-a2cd-4f88-aed8-d54fa2ae0c93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.594921 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64b0cdea-a2cd-4f88-aed8-d54fa2ae0c93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.595518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64b0cdea-a2cd-4f88-aed8-d54fa2ae0c93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.805404 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d6329b6d-f954-4d55-a8aa-2b68d721b5a1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.372513 Jun 24 08:43:44.806092 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 213/425] 10.222.0.13 () {62 vars in 1363 bytes} [Fri Jun 24 08:43:44 2022] POST /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 188 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:43:44.811093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-23575564-e4fa-480a-a834-97f34b58d81f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.812039 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-23575564-e4fa-480a-a834-97f34b58d81f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:44.821202 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23575564-e4fa-480a-a834-97f34b58d81f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.822105 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23575564-e4fa-480a-a834-97f34b58d81f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.823206 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23575564-e4fa-480a-a834-97f34b58d81f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.823830 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23575564-e4fa-480a-a834-97f34b58d81f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.832564 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64b0cdea-a2cd-4f88-aed8-d54fa2ae0c93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:44.841037 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-64b0cdea-a2cd-4f88-aed8-d54fa2ae0c93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1275 microversion: 2.1 time: 0.259305 Jun 24 08:43:44.842881 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 213/426] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:44 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1275 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:44.900250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-23575564-e4fa-480a-a834-97f34b58d81f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:44.909015 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-23575564-e4fa-480a-a834-97f34b58d81f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1270 microversion: 2.1 time: 0.101546 Jun 24 08:43:44.909607 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 214/427] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:44 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:44.935404 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-13c5c182-ccd6-4c12-b9d9-4f649cc670ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:44.935993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-13c5c182-ccd6-4c12-b9d9-4f649cc670ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:44.942733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13c5c182-ccd6-4c12-b9d9-4f649cc670ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.943167 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13c5c182-ccd6-4c12-b9d9-4f649cc670ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.943913 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13c5c182-ccd6-4c12-b9d9-4f649cc670ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.944340 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13c5c182-ccd6-4c12-b9d9-4f649cc670ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:45.040238 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-13c5c182-ccd6-4c12-b9d9-4f649cc670ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/action" status: 202 len: 0 microversion: 2.20 time: 0.108518 Jun 24 08:43:45.040811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 214/428] 10.222.0.13 () {62 vars in 1318 bytes} [Fri Jun 24 08:43:44 2022] POST /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:43:45.050304 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:45.050931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:45.057452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:45.058336 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:45.059197 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:45.059605 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:45.082063 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:45.102685 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2bf7d364-54bc-412b-a19e-e2bd6510b287 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:45.103302 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2bf7d364-54bc-412b-a19e-e2bd6510b287 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:45.115601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2bf7d364-54bc-412b-a19e-e2bd6510b287 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:45.116480 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2bf7d364-54bc-412b-a19e-e2bd6510b287 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:45.118026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2bf7d364-54bc-412b-a19e-e2bd6510b287 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:45.119248 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2bf7d364-54bc-412b-a19e-e2bd6510b287 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:45.269191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:45.287567 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:45.289443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:45.291049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3b920647-d051-41de-93cd-00c8e37a17a0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1808 microversion: 2.20 time: 0.245690 Jun 24 08:43:45.291846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 215/429] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:45 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:43:45.308196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2bf7d364-54bc-412b-a19e-e2bd6510b287 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:45.312435 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:45.317763 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2bf7d364-54bc-412b-a19e-e2bd6510b287 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1509 microversion: 2.1 time: 0.219825 Jun 24 08:43:45.318348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 215/430] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:45 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:45.861607 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-70dc5828-b210-478c-b30f-4928605bf2b5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:45.862256 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-70dc5828-b210-478c-b30f-4928605bf2b5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:45.870858 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-70dc5828-b210-478c-b30f-4928605bf2b5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:45.871309 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-70dc5828-b210-478c-b30f-4928605bf2b5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:45.872106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-70dc5828-b210-478c-b30f-4928605bf2b5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:45.872576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-70dc5828-b210-478c-b30f-4928605bf2b5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:45.926347 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ce5acc5-fb4a-478e-9c04-040bf84c97d7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:45.926922 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1ce5acc5-fb4a-478e-9c04-040bf84c97d7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:45.939635 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce5acc5-fb4a-478e-9c04-040bf84c97d7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:45.942317 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce5acc5-fb4a-478e-9c04-040bf84c97d7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:45.943353 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce5acc5-fb4a-478e-9c04-040bf84c97d7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:45.944193 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce5acc5-fb4a-478e-9c04-040bf84c97d7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.119383 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1ce5acc5-fb4a-478e-9c04-040bf84c97d7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:46.128389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1ce5acc5-fb4a-478e-9c04-040bf84c97d7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1278 microversion: 2.1 time: 0.205851 Jun 24 08:43:46.129110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 216/431] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:45 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:46.247312 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-70dc5828-b210-478c-b30f-4928605bf2b5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:46.256286 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-70dc5828-b210-478c-b30f-4928605bf2b5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.398538 Jun 24 08:43:46.256860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 216/432] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:45 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:46.311506 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:46.312801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:46.320323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.320763 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.321525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.322105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.336361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-378d7b63-3e48-4686-be48-6680261ff3a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:46.337294 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-378d7b63-3e48-4686-be48-6680261ff3a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:46.344424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-378d7b63-3e48-4686-be48-6680261ff3a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.345284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-378d7b63-3e48-4686-be48-6680261ff3a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.346331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-378d7b63-3e48-4686-be48-6680261ff3a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.346922 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-378d7b63-3e48-4686-be48-6680261ff3a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.714727 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:46.721629 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-378d7b63-3e48-4686-be48-6680261ff3a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:46.729269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:46.730702 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-378d7b63-3e48-4686-be48-6680261ff3a7 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1515 microversion: 2.1 time: 0.397887 Jun 24 08:43:46.730818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:46.741984 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b96b1fd3-e397-4132-a8fa-1d2bd9f1a8d8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1808 microversion: 2.20 time: 0.424534 Jun 24 08:43:46.742077 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 217/433] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:46 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:46.742156 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 217/434] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:46 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1808 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:46.874820 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-0b5e7bac-fdd0-44d8-a40f-bf1bb45e1288 req-e71b8f22-a7cd-4d7b-ad7a-0afc656e20d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343f4d48-6760-43ff-884e-cca72945b189", "tag": "2d1085b8-f3d2-4d16-b60d-40af9929f641"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:46.887134 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0b5e7bac-fdd0-44d8-a40f-bf1bb45e1288 req-e71b8f22-a7cd-4d7b-ad7a-0afc656e20d6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.887845 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0b5e7bac-fdd0-44d8-a40f-bf1bb45e1288 req-e71b8f22-a7cd-4d7b-ad7a-0afc656e20d6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.901255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-0b5e7bac-fdd0-44d8-a40f-bf1bb45e1288 req-e71b8f22-a7cd-4d7b-ad7a-0afc656e20d6 service nova] Creating event network-changed:2d1085b8-f3d2-4d16-b60d-40af9929f641 for instance 343f4d48-6760-43ff-884e-cca72945b189 on hv-cinder-84713 Jun 24 08:43:46.909420 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-0b5e7bac-fdd0-44d8-a40f-bf1bb45e1288 req-e71b8f22-a7cd-4d7b-ad7a-0afc656e20d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039123 Jun 24 08:43:46.910327 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 218/435] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:47.147856 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-28c1d6bf-5216-49e7-85e0-5b2a4abc77c1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:47.148522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-28c1d6bf-5216-49e7-85e0-5b2a4abc77c1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:47.162430 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28c1d6bf-5216-49e7-85e0-5b2a4abc77c1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.164026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28c1d6bf-5216-49e7-85e0-5b2a4abc77c1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.167869 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28c1d6bf-5216-49e7-85e0-5b2a4abc77c1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.169717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28c1d6bf-5216-49e7-85e0-5b2a4abc77c1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.267599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-28c1d6bf-5216-49e7-85e0-5b2a4abc77c1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:47.275468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6b7078e6-5409-4c1a-a477-e17785211c8b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:47.276508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6b7078e6-5409-4c1a-a477-e17785211c8b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:47.279385 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-28c1d6bf-5216-49e7-85e0-5b2a4abc77c1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1276 microversion: 2.1 time: 0.135329 Jun 24 08:43:47.282526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 218/436] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:47 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:47.303704 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6b7078e6-5409-4c1a-a477-e17785211c8b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.304036 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6b7078e6-5409-4c1a-a477-e17785211c8b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.304821 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6b7078e6-5409-4c1a-a477-e17785211c8b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.305438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6b7078e6-5409-4c1a-a477-e17785211c8b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.306003 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:47.536968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6b7078e6-5409-4c1a-a477-e17785211c8b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:47.545021 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6b7078e6-5409-4c1a-a477-e17785211c8b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.275179 Jun 24 08:43:47.545610 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 219/437] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:47 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:47.755024 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:47.755912 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:47.762717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.763905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.766234 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.767180 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.919611 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:47.928158 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:47.929648 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:47.930850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c82f7630-8b60-4062-b860-c2412b635c2e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1750 microversion: 2.20 time: 0.179949 Jun 24 08:43:47.931410 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 219/438] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:47 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:48.209191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-71ac200f-7002-4c0d-a88c-75dd8010812c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'create', calling method: .version_select at 0x7f0a7e952d30>, body: {"keypair": {"name": "tempest-keypair-1629404774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLY/ZWSugeumaZOgN/ZAVyIR14bc85acdIad9NigBmbFeVvXKFMpCSoWn9e2YUjQHnX9jHzL3Ay2kKYILO2Ah5ppTJjNRAASJO/g4KgvWdvGI/kpsTD11t/jIZIYiRpVg=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:48.225745 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-71ac200f-7002-4c0d-a88c-75dd8010812c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Getting quotas for project dfa535df5dd14d69bb3ca125cbd9fe13. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:48.229813 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-71ac200f-7002-4c0d-a88c-75dd8010812c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Getting quotas for user 71e0fd73e5c9430c813af1de9ccd4a52 and project dfa535df5dd14d69bb3ca125cbd9fe13. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:48.252747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-71ac200f-7002-4c0d-a88c-75dd8010812c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048152 Jun 24 08:43:48.253383 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 220/439] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:43:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:48.299192 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-26eacfce-0080-407c-869b-bfccbef6ea67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:48.299853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-26eacfce-0080-407c-869b-bfccbef6ea67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:48.305823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26eacfce-0080-407c-869b-bfccbef6ea67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:48.306270 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26eacfce-0080-407c-869b-bfccbef6ea67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:48.307045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26eacfce-0080-407c-869b-bfccbef6ea67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:48.307478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26eacfce-0080-407c-869b-bfccbef6ea67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:48.458780 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-26eacfce-0080-407c-869b-bfccbef6ea67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:48.466390 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-26eacfce-0080-407c-869b-bfccbef6ea67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.171489 Jun 24 08:43:48.466971 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 220/440] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:48 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:48.563664 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c8071939-91df-4717-a1a1-96dc41fcf285 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:48.564188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c8071939-91df-4717-a1a1-96dc41fcf285 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:48.570204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8071939-91df-4717-a1a1-96dc41fcf285 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:48.570645 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8071939-91df-4717-a1a1-96dc41fcf285 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:48.571416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8071939-91df-4717-a1a1-96dc41fcf285 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:48.571843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c8071939-91df-4717-a1a1-96dc41fcf285 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:48.710365 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c8071939-91df-4717-a1a1-96dc41fcf285 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:48.717794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c8071939-91df-4717-a1a1-96dc41fcf285 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.158991 Jun 24 08:43:48.719587 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 221/441] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:48 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:48.949077 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:48.949717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:48.956788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:48.957232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:48.958013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:48.958443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.098652 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:49.107294 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:49.108824 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:49.110667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cc809833-349e-4a91-84e7-6234c47bcbf8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1750 microversion: 2.20 time: 0.165504 Jun 24 08:43:49.111230 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 221/442] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:48 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:43:49.483300 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-691ebc06-37ae-4350-98bc-d15d3dae26cf tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:49.484589 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-691ebc06-37ae-4350-98bc-d15d3dae26cf tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:49.490695 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691ebc06-37ae-4350-98bc-d15d3dae26cf tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:49.491138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691ebc06-37ae-4350-98bc-d15d3dae26cf tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.491888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691ebc06-37ae-4350-98bc-d15d3dae26cf tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:49.492318 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691ebc06-37ae-4350-98bc-d15d3dae26cf tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.632187 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-691ebc06-37ae-4350-98bc-d15d3dae26cf tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:49.641226 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-691ebc06-37ae-4350-98bc-d15d3dae26cf tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.161687 Jun 24 08:43:49.641850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 222/443] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:49 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:49.736425 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7ff06a08-07fd-48fc-bb86-c858378b1490 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:49.737185 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7ff06a08-07fd-48fc-bb86-c858378b1490 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:49.743625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7ff06a08-07fd-48fc-bb86-c858378b1490 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:49.744065 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7ff06a08-07fd-48fc-bb86-c858378b1490 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.744825 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7ff06a08-07fd-48fc-bb86-c858378b1490 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:49.745256 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7ff06a08-07fd-48fc-bb86-c858378b1490 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.773566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-605324913", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4e8b7d0-ce6c-4343-a961-e78a127b98d9"}], "security_groups": [{"name": "tempest-securitygroup--566265716"}], "key_name": "tempest-keypair-1629404774", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:50.142335 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] validate_networks() for [('e4e8b7d0-ce6c-4343-a961-e78a127b98d9', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:43:50.147018 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7ff06a08-07fd-48fc-bb86-c858378b1490 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:50.154622 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7ff06a08-07fd-48fc-bb86-c858378b1490 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.422604 Jun 24 08:43:50.155201 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 222/444] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:49 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:50.160185 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:50.160949 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:50.167089 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.167573 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.168353 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.168795 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.472458 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:50.483254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:50.485372 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:50.486819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e0083b21-6fd5-43de-83cd-ad96d2cf076a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1750 microversion: 2.20 time: 0.330566 Jun 24 08:43:50.487540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 223/445] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:50 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1750 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:50.660633 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eedc2dd4-8247-4ff6-a77c-709cbcfccb0c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:50.661820 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eedc2dd4-8247-4ff6-a77c-709cbcfccb0c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:50.669802 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eedc2dd4-8247-4ff6-a77c-709cbcfccb0c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.670418 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eedc2dd4-8247-4ff6-a77c-709cbcfccb0c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.672241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eedc2dd4-8247-4ff6-a77c-709cbcfccb0c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.672913 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eedc2dd4-8247-4ff6-a77c-709cbcfccb0c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.942890 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:43:50.943929 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:43:50.944774 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:43:50.945351 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:43:50.945963 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:43:50.957504 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.958247 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.959229 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.959837 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.980878 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Getting quotas for project dfa535df5dd14d69bb3ca125cbd9fe13. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:50.985570 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Getting quotas for user 71e0fd73e5c9430c813af1de9ccd4a52 and project dfa535df5dd14d69bb3ca125cbd9fe13. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:51.000374 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:43:51.003225 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:43:51.010863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eedc2dd4-8247-4ff6-a77c-709cbcfccb0c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:51.020677 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eedc2dd4-8247-4ff6-a77c-709cbcfccb0c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.365755 Jun 24 08:43:51.025998 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 224/446] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:50 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:51.033138 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-8333d429-d351-411e-8af0-cf14b90f6fee req-49a1227a-86ef-4142-b9ec-ce21d120d4ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e7e4cb-0993-46e3-b314-6a7a8850a4eb", "tag": "d53cfc38-6644-4e13-ba09-d9d83433beb7"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:51.042141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8333d429-d351-411e-8af0-cf14b90f6fee req-49a1227a-86ef-4142-b9ec-ce21d120d4ab service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:51.042721 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8333d429-d351-411e-8af0-cf14b90f6fee req-49a1227a-86ef-4142-b9ec-ce21d120d4ab service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:51.055428 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-8333d429-d351-411e-8af0-cf14b90f6fee req-49a1227a-86ef-4142-b9ec-ce21d120d4ab service nova] Creating event network-changed:d53cfc38-6644-4e13-ba09-d9d83433beb7 for instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb on hv-cinder-84713 Jun 24 08:43:51.057755 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-74d264b5-3fb4-4abf-9a65-8d18e5735a53 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.288331 Jun 24 08:43:51.058496 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 223/447] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:43:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:43:51.066502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-8333d429-d351-411e-8af0-cf14b90f6fee req-49a1227a-86ef-4142-b9ec-ce21d120d4ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038312 Jun 24 08:43:51.067212 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 225/448] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:51.069837 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-128f6710-52ee-40d8-b297-e0ae0079c9ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:51.070557 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-128f6710-52ee-40d8-b297-e0ae0079c9ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:51.135380 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-128f6710-52ee-40d8-b297-e0ae0079c9ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:51.145676 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-128f6710-52ee-40d8-b297-e0ae0079c9ba tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1245 microversion: 2.1 time: 0.080206 Jun 24 08:43:51.147105 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 224/449] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:51 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:51.173295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-489f8b66-854a-4246-96ce-dac45a5d246b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:51.174152 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-489f8b66-854a-4246-96ce-dac45a5d246b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:51.181076 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-489f8b66-854a-4246-96ce-dac45a5d246b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:51.181524 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-489f8b66-854a-4246-96ce-dac45a5d246b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:51.182350 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-489f8b66-854a-4246-96ce-dac45a5d246b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:51.182789 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-489f8b66-854a-4246-96ce-dac45a5d246b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:51.316352 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:51.337948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:51.341969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-489f8b66-854a-4246-96ce-dac45a5d246b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:51.377974 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-489f8b66-854a-4246-96ce-dac45a5d246b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.208762 Jun 24 08:43:51.379279 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 226/450] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:51 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:51.506000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:51.506239 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:51.514714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:51.515838 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:51.517543 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:51.518279 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:51.817126 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:51.826924 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:51.829326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:51.830871 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2def733d-e591-4a08-9d53-1adc28a0aee2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1750 microversion: 2.20 time: 0.329429 Jun 24 08:43:51.831447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 225/451] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:51 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1750 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:52.039183 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b8e694bc-6c53-4384-a307-3d8644ddfb12 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:52.039902 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b8e694bc-6c53-4384-a307-3d8644ddfb12 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:52.048202 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8e694bc-6c53-4384-a307-3d8644ddfb12 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.048835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8e694bc-6c53-4384-a307-3d8644ddfb12 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.049853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8e694bc-6c53-4384-a307-3d8644ddfb12 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.050988 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8e694bc-6c53-4384-a307-3d8644ddfb12 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.165968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-df64ac1a-951a-47e2-9989-f6b5e8f60eaa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:52.166892 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-df64ac1a-951a-47e2-9989-f6b5e8f60eaa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:52.175417 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df64ac1a-951a-47e2-9989-f6b5e8f60eaa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.175895 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df64ac1a-951a-47e2-9989-f6b5e8f60eaa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.176646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df64ac1a-951a-47e2-9989-f6b5e8f60eaa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.177081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df64ac1a-951a-47e2-9989-f6b5e8f60eaa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.200719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b8e694bc-6c53-4384-a307-3d8644ddfb12 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:52.211413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b8e694bc-6c53-4384-a307-3d8644ddfb12 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.176403 Jun 24 08:43:52.211907 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 227/452] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:52 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:52.244199 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-df64ac1a-951a-47e2-9989-f6b5e8f60eaa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:52.253034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-df64ac1a-951a-47e2-9989-f6b5e8f60eaa tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1297 microversion: 2.1 time: 0.091342 Jun 24 08:43:52.253608 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 226/453] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:52 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:52.395818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7db9768e-991b-4722-8df0-b485a25d9b46 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:52.396427 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7db9768e-991b-4722-8df0-b485a25d9b46 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:52.402604 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7db9768e-991b-4722-8df0-b485a25d9b46 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.403042 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7db9768e-991b-4722-8df0-b485a25d9b46 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.403799 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7db9768e-991b-4722-8df0-b485a25d9b46 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.404227 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7db9768e-991b-4722-8df0-b485a25d9b46 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.544098 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7db9768e-991b-4722-8df0-b485a25d9b46 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:52.551953 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7db9768e-991b-4722-8df0-b485a25d9b46 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.159945 Jun 24 08:43:52.552519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 228/454] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:52 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:52.849791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:52.850313 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:52.856320 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.856766 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.857528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.857996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.998012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.008853 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.011472 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.013514 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3c468525-ec48-4a51-8399-27ed1c95d7f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.167619 Jun 24 08:43:53.014343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 227/455] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:52 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:53.228127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3a3a04e8-78da-45e4-9400-65bd1b711a46 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:53.228758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3a3a04e8-78da-45e4-9400-65bd1b711a46 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:53.235974 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a3a04e8-78da-45e4-9400-65bd1b711a46 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.236418 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a3a04e8-78da-45e4-9400-65bd1b711a46 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.237163 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a3a04e8-78da-45e4-9400-65bd1b711a46 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.237589 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a3a04e8-78da-45e4-9400-65bd1b711a46 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.269453 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bffd959d-2229-460e-9b0e-59c7894d1e30 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:53.270260 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bffd959d-2229-460e-9b0e-59c7894d1e30 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:53.276513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bffd959d-2229-460e-9b0e-59c7894d1e30 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.277038 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bffd959d-2229-460e-9b0e-59c7894d1e30 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.277935 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bffd959d-2229-460e-9b0e-59c7894d1e30 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.278605 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bffd959d-2229-460e-9b0e-59c7894d1e30 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.352137 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bffd959d-2229-460e-9b0e-59c7894d1e30 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.363148 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bffd959d-2229-460e-9b0e-59c7894d1e30 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1297 microversion: 2.1 time: 0.097411 Jun 24 08:43:53.363977 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 228/456] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:53 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:53.436088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3a3a04e8-78da-45e4-9400-65bd1b711a46 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.445109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3a3a04e8-78da-45e4-9400-65bd1b711a46 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.220803 Jun 24 08:43:53.461153 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 229/457] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:53 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:53.571269 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-356a06f5-3403-464e-8df9-f55a2ad1b97f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:53.572144 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-356a06f5-3403-464e-8df9-f55a2ad1b97f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:53.587294 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-356a06f5-3403-464e-8df9-f55a2ad1b97f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.587957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-356a06f5-3403-464e-8df9-f55a2ad1b97f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.589219 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-356a06f5-3403-464e-8df9-f55a2ad1b97f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.590478 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-356a06f5-3403-464e-8df9-f55a2ad1b97f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.883194 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-356a06f5-3403-464e-8df9-f55a2ad1b97f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.891306 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-356a06f5-3403-464e-8df9-f55a2ad1b97f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.325901 Jun 24 08:43:53.891882 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 229/458] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:53 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:54.034960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:54.035581 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:54.041558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.042084 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.042862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.043323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.278705 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:54.299309 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:54.301004 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:54.304659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-092f06e5-a9f7-4924-88bf-be99ad9ee90e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.275512 Jun 24 08:43:54.305835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 230/459] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:54 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:54.384074 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8ba56925-6226-4705-81ff-e0756a02e5eb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:54.384826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8ba56925-6226-4705-81ff-e0756a02e5eb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:54.403748 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8ba56925-6226-4705-81ff-e0756a02e5eb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.404199 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8ba56925-6226-4705-81ff-e0756a02e5eb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.404970 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8ba56925-6226-4705-81ff-e0756a02e5eb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.405682 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8ba56925-6226-4705-81ff-e0756a02e5eb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.471845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b6a9f518-61a0-4b5e-b683-03feb30a2f65 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:54.473955 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b6a9f518-61a0-4b5e-b683-03feb30a2f65 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:54.488968 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b6a9f518-61a0-4b5e-b683-03feb30a2f65 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.491323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b6a9f518-61a0-4b5e-b683-03feb30a2f65 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.492946 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b6a9f518-61a0-4b5e-b683-03feb30a2f65 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.493602 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b6a9f518-61a0-4b5e-b683-03feb30a2f65 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.649284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8ba56925-6226-4705-81ff-e0756a02e5eb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:54.664510 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8ba56925-6226-4705-81ff-e0756a02e5eb tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1303 microversion: 2.1 time: 0.284541 Jun 24 08:43:54.665521 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 230/460] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:54 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1303 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:54.731494 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b6a9f518-61a0-4b5e-b683-03feb30a2f65 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:54.741732 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b6a9f518-61a0-4b5e-b683-03feb30a2f65 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.276526 Jun 24 08:43:54.742307 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 231/461] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:54 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:54.909920 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1fd9effe-057f-4565-8e23-e92fcd20da93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:54.910860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1fd9effe-057f-4565-8e23-e92fcd20da93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:54.924699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1fd9effe-057f-4565-8e23-e92fcd20da93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.926137 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1fd9effe-057f-4565-8e23-e92fcd20da93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.927059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1fd9effe-057f-4565-8e23-e92fcd20da93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.927797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1fd9effe-057f-4565-8e23-e92fcd20da93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.235642 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1fd9effe-057f-4565-8e23-e92fcd20da93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:55.249067 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1fd9effe-057f-4565-8e23-e92fcd20da93 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.344532 Jun 24 08:43:55.249866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 231/462] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:54 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:55.328123 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:55.330205 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:55.340682 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:55.345289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:55.346111 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.347500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:55.348279 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.556111 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:55.568568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:55.570771 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:55.571770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1b192a33-4c94-4f1e-9a7b-bca1aca4cc2c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.251485 Jun 24 08:43:55.572429 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 232/463] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:55 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:55.684004 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-66e9c8aa-1157-4ae6-9599-cb656889355b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:55.685438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-66e9c8aa-1157-4ae6-9599-cb656889355b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:55.692647 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-66e9c8aa-1157-4ae6-9599-cb656889355b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:55.693879 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-66e9c8aa-1157-4ae6-9599-cb656889355b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.695157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-66e9c8aa-1157-4ae6-9599-cb656889355b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:55.695814 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-66e9c8aa-1157-4ae6-9599-cb656889355b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.760499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dfdd8e12-aab2-4665-be88-f7651924ba67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:55.761808 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dfdd8e12-aab2-4665-be88-f7651924ba67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:55.775268 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfdd8e12-aab2-4665-be88-f7651924ba67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:55.775806 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfdd8e12-aab2-4665-be88-f7651924ba67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.776997 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfdd8e12-aab2-4665-be88-f7651924ba67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:55.777589 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfdd8e12-aab2-4665-be88-f7651924ba67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.793538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:55.920099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-66e9c8aa-1157-4ae6-9599-cb656889355b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:55.933832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-66e9c8aa-1157-4ae6-9599-cb656889355b tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.253824 Jun 24 08:43:55.935008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 232/464] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:55 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:56.020601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dfdd8e12-aab2-4665-be88-f7651924ba67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:56.029068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dfdd8e12-aab2-4665-be88-f7651924ba67 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.273045 Jun 24 08:43:56.029637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 233/465] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:55 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:56.266776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-95f888fe-a016-4c29-8b9f-893e7db1031b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:56.267642 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-95f888fe-a016-4c29-8b9f-893e7db1031b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:56.282707 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-95f888fe-a016-4c29-8b9f-893e7db1031b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.283886 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-95f888fe-a016-4c29-8b9f-893e7db1031b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.285534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-95f888fe-a016-4c29-8b9f-893e7db1031b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.286319 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-95f888fe-a016-4c29-8b9f-893e7db1031b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.496000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-95f888fe-a016-4c29-8b9f-893e7db1031b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:56.505228 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-95f888fe-a016-4c29-8b9f-893e7db1031b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.242800 Jun 24 08:43:56.506285 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 233/466] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:56 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:56.590642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:56.591352 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:56.601468 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.604419 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.608085 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.609417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.627358 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-d5c18bc0-0946-41ab-b5b2-0b3292c94853 req-c7ca3ee0-ea05-4efe-a4b9-47d03405645d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e7e4cb-0993-46e3-b314-6a7a8850a4eb", "name": "network-vif-plugged", "status": "completed", "tag": "d53cfc38-6644-4e13-ba09-d9d83433beb7"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:56.647967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-d5c18bc0-0946-41ab-b5b2-0b3292c94853 req-c7ca3ee0-ea05-4efe-a4b9-47d03405645d service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.649136 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-d5c18bc0-0946-41ab-b5b2-0b3292c94853 req-c7ca3ee0-ea05-4efe-a4b9-47d03405645d service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.724305 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-d5c18bc0-0946-41ab-b5b2-0b3292c94853 req-c7ca3ee0-ea05-4efe-a4b9-47d03405645d service nova] Creating event network-vif-plugged:d53cfc38-6644-4e13-ba09-d9d83433beb7 for instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb on hv-cinder-84713 Jun 24 08:43:56.734746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-d5c18bc0-0946-41ab-b5b2-0b3292c94853 req-c7ca3ee0-ea05-4efe-a4b9-47d03405645d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111490 Jun 24 08:43:56.735636 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 234/467] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:56.852127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:56.862835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:56.864759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:56.866416 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3125ca65-eede-4b57-9972-5c7e88119eb6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.279834 Jun 24 08:43:56.867558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 234/468] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:56 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:56.955949 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8076674c-d4b0-4469-bc83-5c99e3c782f9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:56.956705 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8076674c-d4b0-4469-bc83-5c99e3c782f9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:56.965447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8076674c-d4b0-4469-bc83-5c99e3c782f9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.966220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8076674c-d4b0-4469-bc83-5c99e3c782f9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.967408 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8076674c-d4b0-4469-bc83-5c99e3c782f9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.968555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8076674c-d4b0-4469-bc83-5c99e3c782f9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.046990 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-97149b77-ea94-42d0-8690-a3d113980538 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:57.047685 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-97149b77-ea94-42d0-8690-a3d113980538 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:57.056103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97149b77-ea94-42d0-8690-a3d113980538 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.056550 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97149b77-ea94-42d0-8690-a3d113980538 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.057413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97149b77-ea94-42d0-8690-a3d113980538 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.057874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97149b77-ea94-42d0-8690-a3d113980538 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.201800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8076674c-d4b0-4469-bc83-5c99e3c782f9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:57.211364 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8076674c-d4b0-4469-bc83-5c99e3c782f9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.261489 Jun 24 08:43:57.211944 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 235/469] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:56 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:57.277673 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97149b77-ea94-42d0-8690-a3d113980538 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:57.287090 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-97149b77-ea94-42d0-8690-a3d113980538 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.244871 Jun 24 08:43:57.290582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 235/470] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:57 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:57.523487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d14d9a1c-6721-48b7-a15d-f8359d0dad30 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:57.524301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d14d9a1c-6721-48b7-a15d-f8359d0dad30 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:57.530252 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d14d9a1c-6721-48b7-a15d-f8359d0dad30 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.530700 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d14d9a1c-6721-48b7-a15d-f8359d0dad30 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.531503 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d14d9a1c-6721-48b7-a15d-f8359d0dad30 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.531909 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d14d9a1c-6721-48b7-a15d-f8359d0dad30 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.536721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:57.723833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d14d9a1c-6721-48b7-a15d-f8359d0dad30 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:57.732036 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d14d9a1c-6721-48b7-a15d-f8359d0dad30 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.213510 Jun 24 08:43:57.733071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 236/471] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:57 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:57.886511 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:57.887776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:57.896271 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.896997 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.897811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.898238 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.168182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:58.182591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:58.186026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:58.193306 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c2b4dd0-3ecb-426f-9208-ff1a44980d9c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.311082 Jun 24 08:43:58.197276 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 236/472] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:57 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:58.230662 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4985d286-5683-4f12-a924-b6c836b010a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:58.231628 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4985d286-5683-4f12-a924-b6c836b010a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:58.248013 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4985d286-5683-4f12-a924-b6c836b010a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:58.248714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4985d286-5683-4f12-a924-b6c836b010a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.250073 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4985d286-5683-4f12-a924-b6c836b010a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:58.250931 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4985d286-5683-4f12-a924-b6c836b010a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.309634 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2dc90845-f9de-4c6b-98fc-0ee00aba7b9b tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:58.310688 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2dc90845-f9de-4c6b-98fc-0ee00aba7b9b tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:58.320060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2dc90845-f9de-4c6b-98fc-0ee00aba7b9b tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:58.321001 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2dc90845-f9de-4c6b-98fc-0ee00aba7b9b tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.321987 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2dc90845-f9de-4c6b-98fc-0ee00aba7b9b tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:58.322729 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2dc90845-f9de-4c6b-98fc-0ee00aba7b9b tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.836554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4985d286-5683-4f12-a924-b6c836b010a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:58.845154 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4985d286-5683-4f12-a924-b6c836b010a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.618221 Jun 24 08:43:58.845765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 237/473] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:58 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:58.852175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-19e6996d-6070-4961-87b0-10cdccbdb648 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:58.853157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-19e6996d-6070-4961-87b0-10cdccbdb648 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:58.861757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2dc90845-f9de-4c6b-98fc-0ee00aba7b9b tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:58.872663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2dc90845-f9de-4c6b-98fc-0ee00aba7b9b tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.567701 Jun 24 08:43:58.873246 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 237/474] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:58 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:58.877888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19e6996d-6070-4961-87b0-10cdccbdb648 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:58.878398 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19e6996d-6070-4961-87b0-10cdccbdb648 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.879172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19e6996d-6070-4961-87b0-10cdccbdb648 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:58.879790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19e6996d-6070-4961-87b0-10cdccbdb648 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.042500 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-19e6996d-6070-4961-87b0-10cdccbdb648 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:59.052022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-19e6996d-6070-4961-87b0-10cdccbdb648 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.204629 Jun 24 08:43:59.052802 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 238/475] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:58 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:59.218618 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:59.219738 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:59.226320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.227138 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.228150 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.228802 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.454020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:59.463839 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:59.465931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:59.467230 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-603956b7-b0d4-49f8-9fde-b5278241c24d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.253818 Jun 24 08:43:59.468897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 238/476] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:43:59 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:43:59.866755 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aad56bd4-a993-4c0a-b2bf-77d22f2c6f57 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:59.868358 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-aad56bd4-a993-4c0a-b2bf-77d22f2c6f57 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:59.875463 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:59.877265 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aad56bd4-a993-4c0a-b2bf-77d22f2c6f57 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.882620 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aad56bd4-a993-4c0a-b2bf-77d22f2c6f57 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.883587 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aad56bd4-a993-4c0a-b2bf-77d22f2c6f57 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.884117 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aad56bd4-a993-4c0a-b2bf-77d22f2c6f57 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.893413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-253d7f7d-72ab-4705-b773-9810c7225488 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:59.893413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-253d7f7d-72ab-4705-b773-9810c7225488 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:59.910770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-253d7f7d-72ab-4705-b773-9810c7225488 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.911324 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-253d7f7d-72ab-4705-b773-9810c7225488 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.912212 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-253d7f7d-72ab-4705-b773-9810c7225488 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.914243 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-253d7f7d-72ab-4705-b773-9810c7225488 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.180791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aad56bd4-a993-4c0a-b2bf-77d22f2c6f57 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.191984 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aad56bd4-a993-4c0a-b2bf-77d22f2c6f57 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.329378 Jun 24 08:44:00.193444 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 239/477] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:59 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:00.200219 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c59e6ea9-4deb-4ef6-b263-2e3b1f1bab8d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:00.200992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c59e6ea9-4deb-4ef6-b263-2e3b1f1bab8d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:00.209623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c59e6ea9-4deb-4ef6-b263-2e3b1f1bab8d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.210237 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c59e6ea9-4deb-4ef6-b263-2e3b1f1bab8d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.211274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-253d7f7d-72ab-4705-b773-9810c7225488 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.211476 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c59e6ea9-4deb-4ef6-b263-2e3b1f1bab8d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.211850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c59e6ea9-4deb-4ef6-b263-2e3b1f1bab8d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.220393 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-253d7f7d-72ab-4705-b773-9810c7225488 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.332698 Jun 24 08:44:00.220987 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 239/478] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:59 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:00.379851 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c59e6ea9-4deb-4ef6-b263-2e3b1f1bab8d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.389105 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c59e6ea9-4deb-4ef6-b263-2e3b1f1bab8d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.194255 Jun 24 08:44:00.390658 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 240/479] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:00 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:00.488432 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:00.489075 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:00.496329 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.496777 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.497556 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.498016 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.651911 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.661472 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.663059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.664243 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-36006a3d-3859-413c-aea4-347f05e6a9ba tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.180758 Jun 24 08:44:00.664808 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 240/480] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:00 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:00.911001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0e8c68de-d59d-49b7-941f-f3a6cd115848 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:00.914963 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0e8c68de-d59d-49b7-941f-f3a6cd115848 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:00.924209 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0e8c68de-d59d-49b7-941f-f3a6cd115848 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.924796 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0e8c68de-d59d-49b7-941f-f3a6cd115848 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.925581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0e8c68de-d59d-49b7-941f-f3a6cd115848 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.926056 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0e8c68de-d59d-49b7-941f-f3a6cd115848 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.979435 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:01.080809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-0e8c68de-d59d-49b7-941f-f3a6cd115848 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lazy-loading 'services' on Instance uuid 0d5d35ce-c7be-407a-a48d-ef65f3133dbc {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:44:01.139373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=22 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:01.215746 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ea32fe74-a65c-4006-8788-43d436a8e431 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:01.216372 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ea32fe74-a65c-4006-8788-43d436a8e431 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:01.230905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ea32fe74-a65c-4006-8788-43d436a8e431 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.231804 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ea32fe74-a65c-4006-8788-43d436a8e431 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.232281 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ea32fe74-a65c-4006-8788-43d436a8e431 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.232780 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ea32fe74-a65c-4006-8788-43d436a8e431 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.251757 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0e8c68de-d59d-49b7-941f-f3a6cd115848 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/os-volume_attachments/3419c7ca-65a0-4088-84e9-4c9dfaa711b1" status: 202 len: 0 microversion: 2.1 time: 0.344252 Jun 24 08:44:01.252704 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 241/481] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:44:00 2022] DELETE /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/os-volume_attachments/3419c7ca-65a0-4088-84e9-4c9dfaa711b1 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:44:01.270025 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-356239e9-e881-4f38-aecc-7b96cd742ba8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:01.272988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-356239e9-e881-4f38-aecc-7b96cd742ba8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:01.297611 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-356239e9-e881-4f38-aecc-7b96cd742ba8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.298348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-356239e9-e881-4f38-aecc-7b96cd742ba8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.299296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-356239e9-e881-4f38-aecc-7b96cd742ba8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.299882 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-356239e9-e881-4f38-aecc-7b96cd742ba8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.537666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ea32fe74-a65c-4006-8788-43d436a8e431 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:01.564961 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ea32fe74-a65c-4006-8788-43d436a8e431 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.347674 Jun 24 08:44:01.567601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 241/482] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:01 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:01.593725 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-53b13de4-c2ab-4dd9-a623-26ee2ebe228f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:01.594998 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-53b13de4-c2ab-4dd9-a623-26ee2ebe228f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:01.632010 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53b13de4-c2ab-4dd9-a623-26ee2ebe228f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.638748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53b13de4-c2ab-4dd9-a623-26ee2ebe228f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.646726 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53b13de4-c2ab-4dd9-a623-26ee2ebe228f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.649968 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53b13de4-c2ab-4dd9-a623-26ee2ebe228f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.672019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-356239e9-e881-4f38-aecc-7b96cd742ba8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:01.693979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-356239e9-e881-4f38-aecc-7b96cd742ba8 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.439373 Jun 24 08:44:01.694838 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 242/483] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:01 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:01.700437 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:01.701206 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:01.712648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.716372 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.719366 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.719366 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.982101 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-53b13de4-c2ab-4dd9-a623-26ee2ebe228f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:01.992491 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-53b13de4-c2ab-4dd9-a623-26ee2ebe228f tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.423598 Jun 24 08:44:01.994661 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 242/484] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:01 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:02.062510 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:02.079660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:02.087771 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:02.089524 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fffc9e70-1908-42c3-b6a0-73e1ce594ecb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.393525 Jun 24 08:44:02.090509 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 243/485] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:01 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:02.595910 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-42c22334-b97e-45c4-aa14-2c64a2d7961e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:02.597186 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-42c22334-b97e-45c4-aa14-2c64a2d7961e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:02.604270 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42c22334-b97e-45c4-aa14-2c64a2d7961e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:02.604700 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42c22334-b97e-45c4-aa14-2c64a2d7961e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:02.605676 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42c22334-b97e-45c4-aa14-2c64a2d7961e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:02.606297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42c22334-b97e-45c4-aa14-2c64a2d7961e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:02.716283 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ffd03357-8669-457d-8e12-1a5e6f296cbd tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:02.717667 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ffd03357-8669-457d-8e12-1a5e6f296cbd tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:02.729579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ffd03357-8669-457d-8e12-1a5e6f296cbd tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:02.740765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ffd03357-8669-457d-8e12-1a5e6f296cbd tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:02.741996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ffd03357-8669-457d-8e12-1a5e6f296cbd tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:02.742529 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ffd03357-8669-457d-8e12-1a5e6f296cbd tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:02.769314 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-42c22334-b97e-45c4-aa14-2c64a2d7961e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:02.778678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-42c22334-b97e-45c4-aa14-2c64a2d7961e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.187164 Jun 24 08:44:02.790595 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 243/486] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:02 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:02.951698 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ffd03357-8669-457d-8e12-1a5e6f296cbd tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:02.960820 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ffd03357-8669-457d-8e12-1a5e6f296cbd tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.248944 Jun 24 08:44:02.962176 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 244/487] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:02 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:03.014124 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6b17fce6-6d73-480b-b07e-11b69dbcfd5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:03.015020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6b17fce6-6d73-480b-b07e-11b69dbcfd5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:03.021476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b17fce6-6d73-480b-b07e-11b69dbcfd5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.021955 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b17fce6-6d73-480b-b07e-11b69dbcfd5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:03.022767 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b17fce6-6d73-480b-b07e-11b69dbcfd5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.023392 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b17fce6-6d73-480b-b07e-11b69dbcfd5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:03.109319 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:03.110122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:03.121725 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.122452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:03.123379 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.124348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:03.280093 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6b17fce6-6d73-480b-b07e-11b69dbcfd5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:03.289505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6b17fce6-6d73-480b-b07e-11b69dbcfd5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.280566 Jun 24 08:44:03.290555 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 244/488] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:03 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:03.337612 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:03.347870 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:03.349466 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:03.350714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bc2df76a-6168-4f4e-9936-aae00f5e5548 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.246192 Jun 24 08:44:03.351287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 245/489] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:03 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:03.797568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11673955-23fb-4b9b-8578-ba751986a422 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:03.798301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11673955-23fb-4b9b-8578-ba751986a422 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:03.806887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11673955-23fb-4b9b-8578-ba751986a422 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.807247 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11673955-23fb-4b9b-8578-ba751986a422 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:03.808047 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11673955-23fb-4b9b-8578-ba751986a422 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.808476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11673955-23fb-4b9b-8578-ba751986a422 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:03.963141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11673955-23fb-4b9b-8578-ba751986a422 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:03.972220 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11673955-23fb-4b9b-8578-ba751986a422 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.179706 Jun 24 08:44:03.982471 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 245/490] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:03 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:03.986876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1f408451-7c7b-4288-90f6-7eeaca3220eb tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:03.989881 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1f408451-7c7b-4288-90f6-7eeaca3220eb tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:04.003104 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f408451-7c7b-4288-90f6-7eeaca3220eb tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.003567 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f408451-7c7b-4288-90f6-7eeaca3220eb tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.004338 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f408451-7c7b-4288-90f6-7eeaca3220eb tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.004779 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f408451-7c7b-4288-90f6-7eeaca3220eb tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.157626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1f408451-7c7b-4288-90f6-7eeaca3220eb tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:04.165039 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1f408451-7c7b-4288-90f6-7eeaca3220eb tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.190628 Jun 24 08:44:04.165619 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 246/491] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:03 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:04.308824 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-368e4d0c-6f02-457b-9ac4-2248c624625a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:04.309332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-368e4d0c-6f02-457b-9ac4-2248c624625a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:04.315701 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-368e4d0c-6f02-457b-9ac4-2248c624625a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.316166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-368e4d0c-6f02-457b-9ac4-2248c624625a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.316917 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-368e4d0c-6f02-457b-9ac4-2248c624625a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.317342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-368e4d0c-6f02-457b-9ac4-2248c624625a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.370441 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:04.371055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:04.378299 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.378749 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.379527 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.379964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.572538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-368e4d0c-6f02-457b-9ac4-2248c624625a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:04.583375 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-368e4d0c-6f02-457b-9ac4-2248c624625a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.278747 Jun 24 08:44:04.584351 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 246/492] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:04 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:04.659055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:04.670653 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:04.672844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:04.674054 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e44fbac6-ae45-4669-b5a0-3f017f4339b2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.307538 Jun 24 08:44:04.674613 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 247/493] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:04 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:04.990092 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3add2313-4461-435c-9619-d6b26021c4ff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:04.990708 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3add2313-4461-435c-9619-d6b26021c4ff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:04.997753 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3add2313-4461-435c-9619-d6b26021c4ff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.998203 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3add2313-4461-435c-9619-d6b26021c4ff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.000118 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3add2313-4461-435c-9619-d6b26021c4ff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.000728 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3add2313-4461-435c-9619-d6b26021c4ff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.182467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-444befe5-e173-45b5-93c9-dae0ad8ed758 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:05.183081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-444befe5-e173-45b5-93c9-dae0ad8ed758 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:05.189726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-444befe5-e173-45b5-93c9-dae0ad8ed758 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.190623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-444befe5-e173-45b5-93c9-dae0ad8ed758 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.191477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-444befe5-e173-45b5-93c9-dae0ad8ed758 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.191994 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-444befe5-e173-45b5-93c9-dae0ad8ed758 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.201780 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3add2313-4461-435c-9619-d6b26021c4ff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:05.210871 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3add2313-4461-435c-9619-d6b26021c4ff tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.224275 Jun 24 08:44:05.224055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 247/494] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:04 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:05.347358 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-060a8e9d-2091-45b8-8bdf-7dfedde44236 req-68be919b-92b6-41b0-b8a1-a36e7bf4fdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7b568a-ef02-4854-a5e2-96aa05ba02a9", "tag": "3d39ea3a-6eab-4732-b461-bbfa249534b3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:05.356369 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-060a8e9d-2091-45b8-8bdf-7dfedde44236 req-68be919b-92b6-41b0-b8a1-a36e7bf4fdd8 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.357890 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-060a8e9d-2091-45b8-8bdf-7dfedde44236 req-68be919b-92b6-41b0-b8a1-a36e7bf4fdd8 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.384194 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-060a8e9d-2091-45b8-8bdf-7dfedde44236 req-68be919b-92b6-41b0-b8a1-a36e7bf4fdd8 service nova] Creating event network-changed:3d39ea3a-6eab-4732-b461-bbfa249534b3 for instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 on hv-cinder-84713 Jun 24 08:44:05.391703 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-060a8e9d-2091-45b8-8bdf-7dfedde44236 req-68be919b-92b6-41b0-b8a1-a36e7bf4fdd8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048941 Jun 24 08:44:05.392618 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 248/495] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:05.454532 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-444befe5-e173-45b5-93c9-dae0ad8ed758 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:05.464234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-444befe5-e173-45b5-93c9-dae0ad8ed758 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.285491 Jun 24 08:44:05.465543 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 248/496] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:05 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:05.602402 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3c0e8e13-057e-461a-85d1-8f994caa55e8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:05.603126 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3c0e8e13-057e-461a-85d1-8f994caa55e8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:05.610598 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c0e8e13-057e-461a-85d1-8f994caa55e8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.611057 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c0e8e13-057e-461a-85d1-8f994caa55e8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.613476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c0e8e13-057e-461a-85d1-8f994caa55e8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.613476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c0e8e13-057e-461a-85d1-8f994caa55e8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.693249 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:05.694205 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:05.705338 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.705787 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.706572 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.707006 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.800825 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3c0e8e13-057e-461a-85d1-8f994caa55e8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:05.808700 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3c0e8e13-057e-461a-85d1-8f994caa55e8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.210768 Jun 24 08:44:05.809213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 249/497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:05 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:05.862136 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:05.870866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:05.872360 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:05.873898 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f80e8b77-fece-4269-be46-0fdc0d2ba588 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.184547 Jun 24 08:44:05.875122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 249/498] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:05 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:06.231333 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-51e5e59d-d758-4d55-938b-5b5d69017c56 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:06.231933 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-51e5e59d-d758-4d55-938b-5b5d69017c56 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:06.239080 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51e5e59d-d758-4d55-938b-5b5d69017c56 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.239526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51e5e59d-d758-4d55-938b-5b5d69017c56 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.240281 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51e5e59d-d758-4d55-938b-5b5d69017c56 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.240759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51e5e59d-d758-4d55-938b-5b5d69017c56 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.259328 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:06.384515 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-51e5e59d-d758-4d55-938b-5b5d69017c56 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:06.392742 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-51e5e59d-d758-4d55-938b-5b5d69017c56 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.165170 Jun 24 08:44:06.393656 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 250/499] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:06 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:06.482354 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3dd0180e-5c43-447b-b298-0b97c2c3dab1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:06.483222 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3dd0180e-5c43-447b-b298-0b97c2c3dab1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:06.491619 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3dd0180e-5c43-447b-b298-0b97c2c3dab1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.491962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3dd0180e-5c43-447b-b298-0b97c2c3dab1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.495324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3dd0180e-5c43-447b-b298-0b97c2c3dab1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.496393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3dd0180e-5c43-447b-b298-0b97c2c3dab1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.683453 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3dd0180e-5c43-447b-b298-0b97c2c3dab1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:06.691995 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3dd0180e-5c43-447b-b298-0b97c2c3dab1 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.214418 Jun 24 08:44:06.692636 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 250/500] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:06 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:06.826478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b9c5cf3f-fb89-45e1-8869-7924f9966b91 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:06.827137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b9c5cf3f-fb89-45e1-8869-7924f9966b91 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:06.834060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b9c5cf3f-fb89-45e1-8869-7924f9966b91 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.834524 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b9c5cf3f-fb89-45e1-8869-7924f9966b91 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.835469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b9c5cf3f-fb89-45e1-8869-7924f9966b91 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.835902 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b9c5cf3f-fb89-45e1-8869-7924f9966b91 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.892978 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:06.893581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:06.899715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.900415 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.901438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.902126 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.178536 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b9c5cf3f-fb89-45e1-8869-7924f9966b91 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:07.188267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b9c5cf3f-fb89-45e1-8869-7924f9966b91 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.365018 Jun 24 08:44:07.195095 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 251/501] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:06 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:07.197620 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:07.206892 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:07.208408 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:07.209565 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f0d2f3b4-33a0-4f5e-9737-bc416e1e11ed tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.321130 Jun 24 08:44:07.210221 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 251/502] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:06 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:07.409720 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f9af3a69-6616-4428-afe0-444ad46f6ee3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:07.410341 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f9af3a69-6616-4428-afe0-444ad46f6ee3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:07.416566 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9af3a69-6616-4428-afe0-444ad46f6ee3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.417328 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9af3a69-6616-4428-afe0-444ad46f6ee3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.418124 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9af3a69-6616-4428-afe0-444ad46f6ee3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.418718 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9af3a69-6616-4428-afe0-444ad46f6ee3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.633113 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f9af3a69-6616-4428-afe0-444ad46f6ee3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:07.640933 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f9af3a69-6616-4428-afe0-444ad46f6ee3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.235274 Jun 24 08:44:07.641529 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 252/503] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:07 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:07.709159 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f6851e29-0fe8-4796-994f-264d92bf3a1f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:07.709795 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f6851e29-0fe8-4796-994f-264d92bf3a1f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:07.715768 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6851e29-0fe8-4796-994f-264d92bf3a1f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.716208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6851e29-0fe8-4796-994f-264d92bf3a1f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.716961 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6851e29-0fe8-4796-994f-264d92bf3a1f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.717420 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6851e29-0fe8-4796-994f-264d92bf3a1f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.722855 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:07.818340 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eea8fb87-42ef-4b43-be4a-2dac104ca021 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:07.824456 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eea8fb87-42ef-4b43-be4a-2dac104ca021 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.824899 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eea8fb87-42ef-4b43-be4a-2dac104ca021 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.848059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eea8fb87-42ef-4b43-be4a-2dac104ca021 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Going to try to stop instance {{(pid=124380) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 08:44:07.877548 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f6851e29-0fe8-4796-994f-264d92bf3a1f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:07.885508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f6851e29-0fe8-4796-994f-264d92bf3a1f tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1318 microversion: 2.1 time: 0.179820 Jun 24 08:44:07.886138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 252/504] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:07 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:07.894339 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eea8fb87-42ef-4b43-be4a-2dac104ca021 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/action" status: 202 len: 0 microversion: 2.1 time: 0.079624 Jun 24 08:44:07.894948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 253/505] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:44:07 2022] POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:44:07.902845 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-02be6028-dfb6-4ebd-b9da-b570531ee068 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:07.903459 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-02be6028-dfb6-4ebd-b9da-b570531ee068 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:07.910213 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-02be6028-dfb6-4ebd-b9da-b570531ee068 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.910666 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-02be6028-dfb6-4ebd-b9da-b570531ee068 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.911437 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-02be6028-dfb6-4ebd-b9da-b570531ee068 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.911875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-02be6028-dfb6-4ebd-b9da-b570531ee068 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.058368 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-02be6028-dfb6-4ebd-b9da-b570531ee068 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:08.071592 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-02be6028-dfb6-4ebd-b9da-b570531ee068 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.172308 Jun 24 08:44:08.072336 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 253/506] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:07 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:08.205542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1d1cd852-acd7-4919-8695-e76ed9452eb9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:08.206525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1d1cd852-acd7-4919-8695-e76ed9452eb9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:08.212863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d1cd852-acd7-4919-8695-e76ed9452eb9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.213303 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d1cd852-acd7-4919-8695-e76ed9452eb9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.214111 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d1cd852-acd7-4919-8695-e76ed9452eb9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.214546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d1cd852-acd7-4919-8695-e76ed9452eb9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.227674 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:08.228347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:08.236468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.236468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.236468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.236906 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.559945 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1d1cd852-acd7-4919-8695-e76ed9452eb9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:08.570533 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1d1cd852-acd7-4919-8695-e76ed9452eb9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.369815 Jun 24 08:44:08.571640 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:08.571855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 254/507] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:08 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:08.577117 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-c9b985f3-2c06-418e-aa1c-ecffb35f2998 req-4b3a9820-3a1f-44ba-b23b-675d6838bccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343f4d48-6760-43ff-884e-cca72945b189", "name": "network-vif-plugged", "status": "completed", "tag": "2d1085b8-f3d2-4d16-b60d-40af9929f641"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:08.581082 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:08.582623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:08.583798 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c752b2f2-5e16-49e5-b53f-594e3dd48146 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.360912 Jun 24 08:44:08.584350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 254/508] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:08 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:08.596362 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-c9b985f3-2c06-418e-aa1c-ecffb35f2998 req-4b3a9820-3a1f-44ba-b23b-675d6838bccf service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.596808 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-c9b985f3-2c06-418e-aa1c-ecffb35f2998 req-4b3a9820-3a1f-44ba-b23b-675d6838bccf service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.620512 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-c9b985f3-2c06-418e-aa1c-ecffb35f2998 req-4b3a9820-3a1f-44ba-b23b-675d6838bccf service nova] Creating event network-vif-plugged:2d1085b8-f3d2-4d16-b60d-40af9929f641 for instance 343f4d48-6760-43ff-884e-cca72945b189 on hv-cinder-84713 Jun 24 08:44:08.627964 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-c9b985f3-2c06-418e-aa1c-ecffb35f2998 req-4b3a9820-3a1f-44ba-b23b-675d6838bccf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054180 Jun 24 08:44:08.628843 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 255/509] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:08.660478 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f9cea0a6-0af3-4ddc-8bb5-9d72ef2db8a5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:08.660478 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f9cea0a6-0af3-4ddc-8bb5-9d72ef2db8a5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:08.666718 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9cea0a6-0af3-4ddc-8bb5-9d72ef2db8a5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.667392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9cea0a6-0af3-4ddc-8bb5-9d72ef2db8a5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.668353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9cea0a6-0af3-4ddc-8bb5-9d72ef2db8a5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.668960 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9cea0a6-0af3-4ddc-8bb5-9d72ef2db8a5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.843868 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f9cea0a6-0af3-4ddc-8bb5-9d72ef2db8a5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:08.851581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f9cea0a6-0af3-4ddc-8bb5-9d72ef2db8a5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.196526 Jun 24 08:44:08.852719 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 255/510] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:08 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:08.912181 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2038035e-7e54-4e93-a62f-c6b0f1146a75 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:08.912181 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2038035e-7e54-4e93-a62f-c6b0f1146a75 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:08.915182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2038035e-7e54-4e93-a62f-c6b0f1146a75 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.915505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2038035e-7e54-4e93-a62f-c6b0f1146a75 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.916566 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2038035e-7e54-4e93-a62f-c6b0f1146a75 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:08.917006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2038035e-7e54-4e93-a62f-c6b0f1146a75 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.065987 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2038035e-7e54-4e93-a62f-c6b0f1146a75 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.076972 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2038035e-7e54-4e93-a62f-c6b0f1146a75 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1507 microversion: 2.1 time: 0.177754 Jun 24 08:44:09.078004 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 256/511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:08 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:09.091601 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-18a5a8b7-83b4-45c0-aed1-373ef71f94e0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:09.092543 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-18a5a8b7-83b4-45c0-aed1-373ef71f94e0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:09.100031 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-18a5a8b7-83b4-45c0-aed1-373ef71f94e0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.100696 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-18a5a8b7-83b4-45c0-aed1-373ef71f94e0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.101736 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-18a5a8b7-83b4-45c0-aed1-373ef71f94e0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.101956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-18a5a8b7-83b4-45c0-aed1-373ef71f94e0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.258921 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-18a5a8b7-83b4-45c0-aed1-373ef71f94e0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.267982 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-18a5a8b7-83b4-45c0-aed1-373ef71f94e0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.180541 Jun 24 08:44:09.278076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 256/512] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:09 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:09.594962 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9dbf1d26-a54c-4bb0-b0e6-9ae4d146fe5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:09.594962 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9dbf1d26-a54c-4bb0-b0e6-9ae4d146fe5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:09.601174 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dbf1d26-a54c-4bb0-b0e6-9ae4d146fe5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.601838 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dbf1d26-a54c-4bb0-b0e6-9ae4d146fe5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.602538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dbf1d26-a54c-4bb0-b0e6-9ae4d146fe5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.603333 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dbf1d26-a54c-4bb0-b0e6-9ae4d146fe5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.604186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:09.604987 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:09.613350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.614180 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.615189 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.615835 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.821009 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9dbf1d26-a54c-4bb0-b0e6-9ae4d146fe5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.833429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.837265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9dbf1d26-a54c-4bb0-b0e6-9ae4d146fe5d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.246410 Jun 24 08:44:09.837939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 257/513] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:09 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:09.844634 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.846831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.848601 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9ad67947-64a0-4bfe-8538-df4305cc9daf tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.249913 Jun 24 08:44:09.849172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 257/514] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:09 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:09.875489 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b83cb531-ffcd-4f1f-96f7-4ae515caf104 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:09.876102 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b83cb531-ffcd-4f1f-96f7-4ae515caf104 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:09.883218 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b83cb531-ffcd-4f1f-96f7-4ae515caf104 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.884480 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b83cb531-ffcd-4f1f-96f7-4ae515caf104 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.885489 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b83cb531-ffcd-4f1f-96f7-4ae515caf104 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.886127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b83cb531-ffcd-4f1f-96f7-4ae515caf104 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.031219 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b83cb531-ffcd-4f1f-96f7-4ae515caf104 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:10.040073 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b83cb531-ffcd-4f1f-96f7-4ae515caf104 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.169292 Jun 24 08:44:10.040810 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 258/515] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:09 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:10.285007 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8ce3adea-24c8-4165-a7ff-33b6024445f2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:10.285637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8ce3adea-24c8-4165-a7ff-33b6024445f2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:10.292546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8ce3adea-24c8-4165-a7ff-33b6024445f2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.292986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8ce3adea-24c8-4165-a7ff-33b6024445f2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.293808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8ce3adea-24c8-4165-a7ff-33b6024445f2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.294246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8ce3adea-24c8-4165-a7ff-33b6024445f2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.445658 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8ce3adea-24c8-4165-a7ff-33b6024445f2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:10.453635 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8ce3adea-24c8-4165-a7ff-33b6024445f2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.172520 Jun 24 08:44:10.454256 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 258/516] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:10 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:10.854931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-665563ae-fcc0-4834-a9fa-088dcbc4f65c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:10.855579 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-665563ae-fcc0-4834-a9fa-088dcbc4f65c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:10.862925 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-665563ae-fcc0-4834-a9fa-088dcbc4f65c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.863415 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-665563ae-fcc0-4834-a9fa-088dcbc4f65c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.864207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-665563ae-fcc0-4834-a9fa-088dcbc4f65c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.864645 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-665563ae-fcc0-4834-a9fa-088dcbc4f65c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.867474 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:10.868078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:10.874576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.875037 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.875801 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.876231 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.072744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-665563ae-fcc0-4834-a9fa-088dcbc4f65c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:11.080515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:11.081522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-665563ae-fcc0-4834-a9fa-088dcbc4f65c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.230407 Jun 24 08:44:11.082142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 259/517] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:10 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:11.087670 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eedddd26-2b0a-4a7d-92de-78b99cb2700d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:11.088298 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eedddd26-2b0a-4a7d-92de-78b99cb2700d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:11.089175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:11.090699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:11.091868 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-09546d34-6119-470f-8b6c-d9d7bb6c8451 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.228239 Jun 24 08:44:11.092425 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 259/518] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:10 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:11.095285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eedddd26-2b0a-4a7d-92de-78b99cb2700d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.095736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eedddd26-2b0a-4a7d-92de-78b99cb2700d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.096515 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eedddd26-2b0a-4a7d-92de-78b99cb2700d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.096954 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eedddd26-2b0a-4a7d-92de-78b99cb2700d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.236191 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eedddd26-2b0a-4a7d-92de-78b99cb2700d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:11.244172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eedddd26-2b0a-4a7d-92de-78b99cb2700d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.160795 Jun 24 08:44:11.244750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 260/519] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:11 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:11.471562 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9d695efd-7a7f-4ff6-aeab-94a604707b95 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:11.472189 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9d695efd-7a7f-4ff6-aeab-94a604707b95 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:11.478757 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d695efd-7a7f-4ff6-aeab-94a604707b95 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.479344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d695efd-7a7f-4ff6-aeab-94a604707b95 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.479996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d695efd-7a7f-4ff6-aeab-94a604707b95 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.480459 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d695efd-7a7f-4ff6-aeab-94a604707b95 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.612873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9d695efd-7a7f-4ff6-aeab-94a604707b95 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:11.620351 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9d695efd-7a7f-4ff6-aeab-94a604707b95 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.153356 Jun 24 08:44:11.620911 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 260/520] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:11 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:12.099725 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-76931ebc-071b-441b-91ac-c05da360561c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:12.100280 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-76931ebc-071b-441b-91ac-c05da360561c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:12.106903 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76931ebc-071b-441b-91ac-c05da360561c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.107345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76931ebc-071b-441b-91ac-c05da360561c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.108110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76931ebc-071b-441b-91ac-c05da360561c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.109776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76931ebc-071b-441b-91ac-c05da360561c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.111396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:12.112005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:12.118002 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.118443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.119200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.119632 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.317937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-76931ebc-071b-441b-91ac-c05da360561c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:12.321584 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:12.325546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-76931ebc-071b-441b-91ac-c05da360561c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1263 microversion: 2.1 time: 0.229682 Jun 24 08:44:12.326162 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 261/521] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:12 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1263 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:12.331519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-414a54e0-6078-4c3b-813f-1f8381cd930f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:12.340638 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:12.341498 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-414a54e0-6078-4c3b-813f-1f8381cd930f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:12.341679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:12.341679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-db4ce6c9-a69c-4294-8882-b0d1f683ca56 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.227917 Jun 24 08:44:12.341679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 261/522] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:12 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:12.342148 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-414a54e0-6078-4c3b-813f-1f8381cd930f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.342148 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-414a54e0-6078-4c3b-813f-1f8381cd930f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.342148 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-414a54e0-6078-4c3b-813f-1f8381cd930f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.342148 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-414a54e0-6078-4c3b-813f-1f8381cd930f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.484329 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-414a54e0-6078-4c3b-813f-1f8381cd930f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:12.492142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-414a54e0-6078-4c3b-813f-1f8381cd930f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.164957 Jun 24 08:44:12.492727 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 262/523] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:12 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:12.638812 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4b98b3c7-2b73-48ba-acc1-b5c0ef20725b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:12.640147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4b98b3c7-2b73-48ba-acc1-b5c0ef20725b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:12.646660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4b98b3c7-2b73-48ba-acc1-b5c0ef20725b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.647107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4b98b3c7-2b73-48ba-acc1-b5c0ef20725b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.647859 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4b98b3c7-2b73-48ba-acc1-b5c0ef20725b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.648284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4b98b3c7-2b73-48ba-acc1-b5c0ef20725b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.785045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4b98b3c7-2b73-48ba-acc1-b5c0ef20725b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:12.793915 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4b98b3c7-2b73-48ba-acc1-b5c0ef20725b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.158842 Jun 24 08:44:12.794552 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 262/524] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:12 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:13.343382 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d60a2af2-b0b3-462d-8d09-22afa471847a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:13.344729 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d60a2af2-b0b3-462d-8d09-22afa471847a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:13.351922 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d60a2af2-b0b3-462d-8d09-22afa471847a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.352367 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d60a2af2-b0b3-462d-8d09-22afa471847a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.353146 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d60a2af2-b0b3-462d-8d09-22afa471847a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.353587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d60a2af2-b0b3-462d-8d09-22afa471847a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.360566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:13.361350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:13.367500 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.368527 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.369538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.370205 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.569446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d60a2af2-b0b3-462d-8d09-22afa471847a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:13.578500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d60a2af2-b0b3-462d-8d09-22afa471847a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1448 microversion: 2.1 time: 0.239517 Jun 24 08:44:13.579327 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 263/525] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:13 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1448 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:13.585956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:13.591934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7f71f259-a00d-4041-89b6-4f8d555b3543 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:13.593289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7f71f259-a00d-4041-89b6-4f8d555b3543 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:13.593848 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:13.596666 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:13.598840 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a5e43fd3-f1b3-485d-b864-39fffe4605d7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.248158 Jun 24 08:44:13.599847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 263/526] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:13 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:13.600603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f71f259-a00d-4041-89b6-4f8d555b3543 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.601150 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f71f259-a00d-4041-89b6-4f8d555b3543 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.602056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f71f259-a00d-4041-89b6-4f8d555b3543 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.602699 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f71f259-a00d-4041-89b6-4f8d555b3543 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.609051 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-03c98242-148f-43c6-8985-ff4c4d4ce078 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:13.610181 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-03c98242-148f-43c6-8985-ff4c4d4ce078 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:13.620174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-03c98242-148f-43c6-8985-ff4c4d4ce078 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.621052 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-03c98242-148f-43c6-8985-ff4c4d4ce078 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.622429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-03c98242-148f-43c6-8985-ff4c4d4ce078 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.623215 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-03c98242-148f-43c6-8985-ff4c4d4ce078 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.035728 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7f71f259-a00d-4041-89b6-4f8d555b3543 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:14.043125 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7f71f259-a00d-4041-89b6-4f8d555b3543 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.455536 Jun 24 08:44:14.043702 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 264/527] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:13 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:14.058152 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9dd1e7b2-471b-41f3-8703-ff0b6e3374f7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:14.058765 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9dd1e7b2-471b-41f3-8703-ff0b6e3374f7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:14.065560 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dd1e7b2-471b-41f3-8703-ff0b6e3374f7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.066207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dd1e7b2-471b-41f3-8703-ff0b6e3374f7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.066985 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dd1e7b2-471b-41f3-8703-ff0b6e3374f7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.067420 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dd1e7b2-471b-41f3-8703-ff0b6e3374f7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.067923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-03c98242-148f-43c6-8985-ff4c4d4ce078 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:14.077834 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-03c98242-148f-43c6-8985-ff4c4d4ce078 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1448 microversion: 2.1 time: 0.475985 Jun 24 08:44:14.078469 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 264/528] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:13 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1448 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:14.216649 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9dd1e7b2-471b-41f3-8703-ff0b6e3374f7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:14.224490 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9dd1e7b2-471b-41f3-8703-ff0b6e3374f7 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.170300 Jun 24 08:44:14.225069 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 265/529] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:14 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:14.618134 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:14.618889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:14.629383 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.630087 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.631076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.634443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-b8c0f378-9066-4615-ac77-4d3a1570faa8 req-de4d7e63-d85c-4b84-a0be-14b72646cddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7b568a-ef02-4854-a5e2-96aa05ba02a9", "name": "network-vif-plugged", "status": "completed", "tag": "3d39ea3a-6eab-4732-b461-bbfa249534b3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:14.635666 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.657681 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-b8c0f378-9066-4615-ac77-4d3a1570faa8 req-de4d7e63-d85c-4b84-a0be-14b72646cddb service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.658426 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-b8c0f378-9066-4615-ac77-4d3a1570faa8 req-de4d7e63-d85c-4b84-a0be-14b72646cddb service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.678552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-b8c0f378-9066-4615-ac77-4d3a1570faa8 req-de4d7e63-d85c-4b84-a0be-14b72646cddb service nova] Creating event network-vif-plugged:3d39ea3a-6eab-4732-b461-bbfa249534b3 for instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 on hv-cinder-84713 Jun 24 08:44:14.684769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-b8c0f378-9066-4615-ac77-4d3a1570faa8 req-de4d7e63-d85c-4b84-a0be-14b72646cddb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054173 Jun 24 08:44:14.686150 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 266/530] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:15.026464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.036965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.038839 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.040875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-08222b38-f6e6-4278-bd78-150505a60bf9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.426739 Jun 24 08:44:15.041777 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 265/531] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:14 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:15.061180 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a700b1c-8947-47b6-a62c-e707ef2eb3ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:15.062016 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a700b1c-8947-47b6-a62c-e707ef2eb3ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:15.070926 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a700b1c-8947-47b6-a62c-e707ef2eb3ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.071754 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a700b1c-8947-47b6-a62c-e707ef2eb3ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.072650 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a700b1c-8947-47b6-a62c-e707ef2eb3ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.073356 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a700b1c-8947-47b6-a62c-e707ef2eb3ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.097418 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:15.241927 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-452e1f40-5287-45da-a7e7-0f9e2cf72044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:15.242837 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-452e1f40-5287-45da-a7e7-0f9e2cf72044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:15.249880 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-452e1f40-5287-45da-a7e7-0f9e2cf72044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.250372 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-452e1f40-5287-45da-a7e7-0f9e2cf72044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.251349 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-452e1f40-5287-45da-a7e7-0f9e2cf72044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.251782 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-452e1f40-5287-45da-a7e7-0f9e2cf72044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.421639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a700b1c-8947-47b6-a62c-e707ef2eb3ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.429212 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a700b1c-8947-47b6-a62c-e707ef2eb3ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.372475 Jun 24 08:44:15.429815 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 267/532] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:15 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:15.540513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-452e1f40-5287-45da-a7e7-0f9e2cf72044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.548663 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-452e1f40-5287-45da-a7e7-0f9e2cf72044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.310728 Jun 24 08:44:15.549237 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 266/533] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:15 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:16.061647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:16.062603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:16.069313 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.069907 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.070762 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.071262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.365664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.380244 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.380244 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.380244 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-62be5a5b-8614-4e78-99d6-df31e94ce354 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.320867 Jun 24 08:44:16.380613 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 268/534] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:16 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:16.446847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-55bdf60f-8bc1-42b5-80d3-c417f049061d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:16.447471 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-55bdf60f-8bc1-42b5-80d3-c417f049061d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:16.454306 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-55bdf60f-8bc1-42b5-80d3-c417f049061d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.455006 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-55bdf60f-8bc1-42b5-80d3-c417f049061d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.455993 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-55bdf60f-8bc1-42b5-80d3-c417f049061d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.456598 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-55bdf60f-8bc1-42b5-80d3-c417f049061d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.566144 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eef1485b-4fed-4407-8a23-833069dafc03 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:16.566911 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eef1485b-4fed-4407-8a23-833069dafc03 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:16.573243 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eef1485b-4fed-4407-8a23-833069dafc03 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.573836 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eef1485b-4fed-4407-8a23-833069dafc03 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.574745 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eef1485b-4fed-4407-8a23-833069dafc03 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.575291 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eef1485b-4fed-4407-8a23-833069dafc03 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.689151 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-55bdf60f-8bc1-42b5-80d3-c417f049061d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.709307 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-55bdf60f-8bc1-42b5-80d3-c417f049061d tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1370 microversion: 2.1 time: 0.255268 Jun 24 08:44:16.713893 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 267/535] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:16 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:16.720726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-888054bf-4c24-4070-a503-02e67bce49c6 req-a3160c8d-5e85-444c-ae45-0c880fd3a40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343f4d48-6760-43ff-884e-cca72945b189", "tag": "2d1085b8-f3d2-4d16-b60d-40af9929f641"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:16.730271 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-888054bf-4c24-4070-a503-02e67bce49c6 req-a3160c8d-5e85-444c-ae45-0c880fd3a40e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.730889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-888054bf-4c24-4070-a503-02e67bce49c6 req-a3160c8d-5e85-444c-ae45-0c880fd3a40e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.744804 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-888054bf-4c24-4070-a503-02e67bce49c6 req-a3160c8d-5e85-444c-ae45-0c880fd3a40e service nova] Creating event network-changed:2d1085b8-f3d2-4d16-b60d-40af9929f641 for instance 343f4d48-6760-43ff-884e-cca72945b189 on hv-cinder-84713 Jun 24 08:44:16.751921 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-888054bf-4c24-4070-a503-02e67bce49c6 req-a3160c8d-5e85-444c-ae45-0c880fd3a40e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036196 Jun 24 08:44:16.753069 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 268/536] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:16.781663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eef1485b-4fed-4407-8a23-833069dafc03 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.790235 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eef1485b-4fed-4407-8a23-833069dafc03 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.228182 Jun 24 08:44:16.791663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 269/537] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:16 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:17.398615 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:17.399415 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:17.406546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.407127 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.407965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.408467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.429510 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:17.630024 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.645018 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.647191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.648805 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ace97fd3-d1b1-4c1b-8e9f-e8c2e4ff8a5a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.254592 Jun 24 08:44:17.651559 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 269/538] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:17 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:17.727840 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9accd4f1-df4e-4b4b-b01f-0e7703bc106c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:17.729056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9accd4f1-df4e-4b4b-b01f-0e7703bc106c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:17.746707 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9accd4f1-df4e-4b4b-b01f-0e7703bc106c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.747168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9accd4f1-df4e-4b4b-b01f-0e7703bc106c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.748132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9accd4f1-df4e-4b4b-b01f-0e7703bc106c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.748963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9accd4f1-df4e-4b4b-b01f-0e7703bc106c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.808770 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-14b0b405-75a9-45d1-986b-1f0e0d926fc6 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:17.809386 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-14b0b405-75a9-45d1-986b-1f0e0d926fc6 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:17.816205 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14b0b405-75a9-45d1-986b-1f0e0d926fc6 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.816648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14b0b405-75a9-45d1-986b-1f0e0d926fc6 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.817571 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14b0b405-75a9-45d1-986b-1f0e0d926fc6 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.825866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14b0b405-75a9-45d1-986b-1f0e0d926fc6 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.083613 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9accd4f1-df4e-4b4b-b01f-0e7703bc106c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.091107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9accd4f1-df4e-4b4b-b01f-0e7703bc106c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1563 microversion: 2.1 time: 0.367500 Jun 24 08:44:18.091692 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 270/539] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:17 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1563 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:18.100957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14b0b405-75a9-45d1-986b-1f0e0d926fc6 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.108873 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dbab223d-5061-474e-b52a-e9818d39a957 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:18.109058 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-14b0b405-75a9-45d1-986b-1f0e0d926fc6 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.304540 Jun 24 08:44:18.109368 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dbab223d-5061-474e-b52a-e9818d39a957 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:18.109637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 270/540] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:17 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:18.115725 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbab223d-5061-474e-b52a-e9818d39a957 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.116175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbab223d-5061-474e-b52a-e9818d39a957 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.116948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbab223d-5061-474e-b52a-e9818d39a957 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.117385 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbab223d-5061-474e-b52a-e9818d39a957 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.240075 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dbab223d-5061-474e-b52a-e9818d39a957 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135678 Jun 24 08:44:18.240675 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 271/541] 10.222.0.13 () {58 vars in 1274 bytes} [Fri Jun 24 08:44:18 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:18.672545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:18.673223 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:18.679679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.680129 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.680901 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.681338 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.808621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-fafa626c-0e89-4517-8ff4-526c2d2d80dd req-462b7318-0f75-4967-8c74-5154118a6829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6c82-2da5-46c9-8757-4fa70bfa79b1", "name": "network-vif-plugged", "status": "completed", "tag": "24b20858-8a37-47d6-98c3-e6bff8bd12c1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:18.822984 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-fafa626c-0e89-4517-8ff4-526c2d2d80dd req-462b7318-0f75-4967-8c74-5154118a6829 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.823681 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-fafa626c-0e89-4517-8ff4-526c2d2d80dd req-462b7318-0f75-4967-8c74-5154118a6829 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.836939 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.850014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-fafa626c-0e89-4517-8ff4-526c2d2d80dd req-462b7318-0f75-4967-8c74-5154118a6829 service nova] Creating event network-vif-plugged:24b20858-8a37-47d6-98c3-e6bff8bd12c1 for instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 on hv-cinder-84713 Jun 24 08:44:18.850457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.852753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.854295 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-237a389c-6b8b-4406-a2ea-81932768c70a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.187000 Jun 24 08:44:18.855403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 271/542] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:18 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:18.866095 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-fafa626c-0e89-4517-8ff4-526c2d2d80dd req-462b7318-0f75-4967-8c74-5154118a6829 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050776 Jun 24 08:44:18.867245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 272/543] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:19.127240 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5799881e-e1bb-45e9-850c-9beacb75ff2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:19.127901 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5799881e-e1bb-45e9-850c-9beacb75ff2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:19.134256 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5799881e-e1bb-45e9-850c-9beacb75ff2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.134704 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5799881e-e1bb-45e9-850c-9beacb75ff2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.135482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5799881e-e1bb-45e9-850c-9beacb75ff2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.135948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5799881e-e1bb-45e9-850c-9beacb75ff2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.281013 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5799881e-e1bb-45e9-850c-9beacb75ff2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:19.290510 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5799881e-e1bb-45e9-850c-9beacb75ff2f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.168459 Jun 24 08:44:19.291464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 272/544] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:19 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:19.680236 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-b9ba163c-5601-4ac7-ad3b-e34a93e5d74c req-5377cf86-4c73-4d0d-885d-f7531f23fa67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7b568a-ef02-4854-a5e2-96aa05ba02a9", "tag": "3d39ea3a-6eab-4732-b461-bbfa249534b3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:19.689975 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-b9ba163c-5601-4ac7-ad3b-e34a93e5d74c req-5377cf86-4c73-4d0d-885d-f7531f23fa67 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.690420 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-b9ba163c-5601-4ac7-ad3b-e34a93e5d74c req-5377cf86-4c73-4d0d-885d-f7531f23fa67 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.708516 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-b9ba163c-5601-4ac7-ad3b-e34a93e5d74c req-5377cf86-4c73-4d0d-885d-f7531f23fa67 service nova] Creating event network-changed:3d39ea3a-6eab-4732-b461-bbfa249534b3 for instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 on hv-cinder-84713 Jun 24 08:44:19.714005 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-b9ba163c-5601-4ac7-ad3b-e34a93e5d74c req-5377cf86-4c73-4d0d-885d-f7531f23fa67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038083 Jun 24 08:44:19.714611 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 273/545] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:19.874447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:19.875080 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:19.881068 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.881507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.882359 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.882789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.052883 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:20.065111 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:20.066849 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:20.079889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0fd6808d-4c9f-4d29-a8e8-6b2e90e54e0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.198282 Jun 24 08:44:20.079889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 273/546] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:19 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:20.308567 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9a74571c-a1d2-4b0f-a502-cbc279c1d99a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:20.309297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9a74571c-a1d2-4b0f-a502-cbc279c1d99a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:20.316636 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a74571c-a1d2-4b0f-a502-cbc279c1d99a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.317059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a74571c-a1d2-4b0f-a502-cbc279c1d99a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.317845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a74571c-a1d2-4b0f-a502-cbc279c1d99a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.318275 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a74571c-a1d2-4b0f-a502-cbc279c1d99a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.460305 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9a74571c-a1d2-4b0f-a502-cbc279c1d99a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:20.469107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9a74571c-a1d2-4b0f-a502-cbc279c1d99a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.163967 Jun 24 08:44:20.469891 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 274/547] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:20 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:21.087787 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:21.088509 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:21.095228 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:21.095755 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.096617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:21.097172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.488255 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ce3e808-0a11-4f33-9aa7-fa494b104ea4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:21.489158 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1ce3e808-0a11-4f33-9aa7-fa494b104ea4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:21.490400 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.496690 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce3e808-0a11-4f33-9aa7-fa494b104ea4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:21.497274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce3e808-0a11-4f33-9aa7-fa494b104ea4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.499059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce3e808-0a11-4f33-9aa7-fa494b104ea4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:21.500558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce3e808-0a11-4f33-9aa7-fa494b104ea4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.508036 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.509987 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.511244 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e0f338ba-ee0d-4442-961c-0f1e25316c65 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1806 microversion: 2.20 time: 0.427364 Jun 24 08:44:21.522234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 274/548] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:21 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1806 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:21.643380 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1ce3e808-0a11-4f33-9aa7-fa494b104ea4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.652638 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1ce3e808-0a11-4f33-9aa7-fa494b104ea4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.169620 Jun 24 08:44:21.653358 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 275/549] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:21 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:22.530762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:22.531306 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:22.537216 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.537655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.538430 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.538862 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.671296 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b53ebc84-c894-411f-9f18-3dbf4e68052f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:22.672125 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b53ebc84-c894-411f-9f18-3dbf4e68052f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:22.678712 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b53ebc84-c894-411f-9f18-3dbf4e68052f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.679154 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b53ebc84-c894-411f-9f18-3dbf4e68052f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.679925 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b53ebc84-c894-411f-9f18-3dbf4e68052f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.680355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b53ebc84-c894-411f-9f18-3dbf4e68052f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.681741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.690907 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.692539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.693832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4487ed8d-0b49-4077-98eb-f03d5e4928ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1793 microversion: 2.20 time: 0.167090 Jun 24 08:44:22.694482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 275/550] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:22 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1793 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:22.816188 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b53ebc84-c894-411f-9f18-3dbf4e68052f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.823668 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b53ebc84-c894-411f-9f18-3dbf4e68052f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1677 microversion: 2.1 time: 0.157072 Jun 24 08:44:22.824267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 276/551] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:22 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:23.840724 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f45ab798-b8fb-4209-b024-c3a05751a3db tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.841335 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f45ab798-b8fb-4209-b024-c3a05751a3db tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:23.847728 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f45ab798-b8fb-4209-b024-c3a05751a3db tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.848199 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f45ab798-b8fb-4209-b024-c3a05751a3db tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.848958 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f45ab798-b8fb-4209-b024-c3a05751a3db tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.849387 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f45ab798-b8fb-4209-b024-c3a05751a3db tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.982112 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f45ab798-b8fb-4209-b024-c3a05751a3db tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.991028 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f45ab798-b8fb-4209-b024-c3a05751a3db tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1654 microversion: 2.1 time: 0.154395 Jun 24 08:44:23.991609 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 276/552] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:24.007783 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f1029684-b8ec-46cd-88c0-9e3fd87eb693 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:24.016278 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1029684-b8ec-46cd-88c0-9e3fd87eb693 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.016723 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1029684-b8ec-46cd-88c0-9e3fd87eb693 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.038444 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f1029684-b8ec-46cd-88c0-9e3fd87eb693 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Going to try to start instance {{(pid=124380) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 08:44:24.082790 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f1029684-b8ec-46cd-88c0-9e3fd87eb693 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/action" status: 202 len: 0 microversion: 2.1 time: 0.078667 Jun 24 08:44:24.083589 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 277/553] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:44:24 2022] POST /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:44:24.091881 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2ddcd3d0-9ed0-47a4-9cce-f4592d417f36 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:24.093014 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2ddcd3d0-9ed0-47a4-9cce-f4592d417f36 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:24.099043 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ddcd3d0-9ed0-47a4-9cce-f4592d417f36 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.099485 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ddcd3d0-9ed0-47a4-9cce-f4592d417f36 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.100246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ddcd3d0-9ed0-47a4-9cce-f4592d417f36 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.100809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ddcd3d0-9ed0-47a4-9cce-f4592d417f36 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.250884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2ddcd3d0-9ed0-47a4-9cce-f4592d417f36 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:24.258850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2ddcd3d0-9ed0-47a4-9cce-f4592d417f36 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1663 microversion: 2.1 time: 0.170799 Jun 24 08:44:24.259432 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 277/554] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:24 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:25.276989 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c9951621-9122-496d-95a9-4af21ff22db5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:25.277712 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c9951621-9122-496d-95a9-4af21ff22db5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:25.284505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9951621-9122-496d-95a9-4af21ff22db5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.284944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9951621-9122-496d-95a9-4af21ff22db5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.285714 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9951621-9122-496d-95a9-4af21ff22db5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.286142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9951621-9122-496d-95a9-4af21ff22db5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.427924 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c9951621-9122-496d-95a9-4af21ff22db5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:25.435305 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c9951621-9122-496d-95a9-4af21ff22db5 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1663 microversion: 2.1 time: 0.162540 Jun 24 08:44:25.435863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 278/555] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:25 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:26.453095 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5093fb4e-2584-4b92-a15f-a1f0f70575b3 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:26.453715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5093fb4e-2584-4b92-a15f-a1f0f70575b3 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:26.459654 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5093fb4e-2584-4b92-a15f-a1f0f70575b3 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.460092 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5093fb4e-2584-4b92-a15f-a1f0f70575b3 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:26.460840 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5093fb4e-2584-4b92-a15f-a1f0f70575b3 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.461270 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5093fb4e-2584-4b92-a15f-a1f0f70575b3 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:26.594285 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5093fb4e-2584-4b92-a15f-a1f0f70575b3 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:26.601618 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5093fb4e-2584-4b92-a15f-a1f0f70575b3 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1667 microversion: 2.1 time: 0.153296 Jun 24 08:44:26.602206 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 278/556] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:26 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:28.543246 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e4edb047-4fc4-405e-88f1-418b7c189602 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c050843a-c319-4833-ab32-075914d9a016", "device": "/dev/sdb"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:28.544822 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e4edb047-4fc4-405e-88f1-418b7c189602 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:28.547444 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=94 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:28.552660 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e4edb047-4fc4-405e-88f1-418b7c189602 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:28.553097 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e4edb047-4fc4-405e-88f1-418b7c189602 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:28.553883 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e4edb047-4fc4-405e-88f1-418b7c189602 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:28.554312 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e4edb047-4fc4-405e-88f1-418b7c189602 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:28.815300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e4edb047-4fc4-405e-88f1-418b7c189602 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "POST /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275862 Jun 24 08:44:28.815908 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 279/557] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:44:28 2022] POST /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:52.483939 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-16c27c52-561f-4f6c-96b8-7ff3438fdba4 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:52.484501 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-16c27c52-561f-4f6c-96b8-7ff3438fdba4 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:52.486820 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=79 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:52.487471 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=56 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:52.493237 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-16c27c52-561f-4f6c-96b8-7ff3438fdba4 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.493700 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-16c27c52-561f-4f6c-96b8-7ff3438fdba4 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.494488 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-16c27c52-561f-4f6c-96b8-7ff3438fdba4 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.494928 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-16c27c52-561f-4f6c-96b8-7ff3438fdba4 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.578272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-16c27c52-561f-4f6c-96b8-7ff3438fdba4 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lazy-loading 'services' on Instance uuid f0e7e4cb-0993-46e3-b314-6a7a8850a4eb {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:44:52.650969 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-16c27c52-561f-4f6c-96b8-7ff3438fdba4 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb/os-volume_attachments/c050843a-c319-4833-ab32-075914d9a016" status: 202 len: 0 microversion: 2.1 time: 0.170826 Jun 24 08:44:52.651593 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 279/558] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:44:52 2022] DELETE /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb/os-volume_attachments/c050843a-c319-4833-ab32-075914d9a016 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:44:53.766583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:53.767732 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:53.773149 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4049e8bf-9ea1-4092-9e83-2328ddcf0657 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:53.773845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4049e8bf-9ea1-4092-9e83-2328ddcf0657 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:53.781842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4049e8bf-9ea1-4092-9e83-2328ddcf0657 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.782291 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4049e8bf-9ea1-4092-9e83-2328ddcf0657 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.783055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4049e8bf-9ea1-4092-9e83-2328ddcf0657 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.783555 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4049e8bf-9ea1-4092-9e83-2328ddcf0657 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.810112 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4049e8bf-9ea1-4092-9e83-2328ddcf0657 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:44:53.904700 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4049e8bf-9ea1-4092-9e83-2328ddcf0657 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 204 len: 0 microversion: 2.1 time: 0.140007 Jun 24 08:44:53.905721 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 280/559] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:44:53 2022] DELETE /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:44:53.916062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f7266bfb-d9f5-4782-8015-ad8c0dbcd452 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:53.916772 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f7266bfb-d9f5-4782-8015-ad8c0dbcd452 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:53.923250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f7266bfb-d9f5-4782-8015-ad8c0dbcd452 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.923699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f7266bfb-d9f5-4782-8015-ad8c0dbcd452 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.924468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f7266bfb-d9f5-4782-8015-ad8c0dbcd452 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.924908 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f7266bfb-d9f5-4782-8015-ad8c0dbcd452 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:54.056904 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f7266bfb-d9f5-4782-8015-ad8c0dbcd452 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:54.065343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f7266bfb-d9f5-4782-8015-ad8c0dbcd452 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1513 microversion: 2.1 time: 0.153693 Jun 24 08:44:54.065950 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 280/560] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:53 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:55.083923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-db7db7e0-d65e-4d86-8a9e-507f7e4c4f45 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:55.084542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-db7db7e0-d65e-4d86-8a9e-507f7e4c4f45 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:55.091081 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db7db7e0-d65e-4d86-8a9e-507f7e4c4f45 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:55.091531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db7db7e0-d65e-4d86-8a9e-507f7e4c4f45 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:55.092296 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db7db7e0-d65e-4d86-8a9e-507f7e4c4f45 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:55.092736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db7db7e0-d65e-4d86-8a9e-507f7e4c4f45 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:55.229205 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-db7db7e0-d65e-4d86-8a9e-507f7e4c4f45 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:55.237172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-db7db7e0-d65e-4d86-8a9e-507f7e4c4f45 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1513 microversion: 2.1 time: 0.157594 Jun 24 08:44:55.237761 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 281/561] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:55 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:56.255072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3645a47c-c703-4fe7-aac4-4a0afaeedd4c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:56.255677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3645a47c-c703-4fe7-aac4-4a0afaeedd4c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:56.262503 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3645a47c-c703-4fe7-aac4-4a0afaeedd4c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.262984 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3645a47c-c703-4fe7-aac4-4a0afaeedd4c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.263608 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3645a47c-c703-4fe7-aac4-4a0afaeedd4c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.264041 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3645a47c-c703-4fe7-aac4-4a0afaeedd4c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.490242 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3645a47c-c703-4fe7-aac4-4a0afaeedd4c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:56.498485 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3645a47c-c703-4fe7-aac4-4a0afaeedd4c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 200 len: 1513 microversion: 2.1 time: 0.247108 Jun 24 08:44:56.500417 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 281/562] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:56 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:56.834361 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-d1208460-0544-4e40-bca7-99735bb96d99 req-d44d7bee-07fa-4253-8af8-520c4086f127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e7e4cb-0993-46e3-b314-6a7a8850a4eb", "name": "network-vif-deleted", "tag": "d53cfc38-6644-4e13-ba09-d9d83433beb7"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:56.843136 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-d1208460-0544-4e40-bca7-99735bb96d99 req-d44d7bee-07fa-4253-8af8-520c4086f127 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.843587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-d1208460-0544-4e40-bca7-99735bb96d99 req-d44d7bee-07fa-4253-8af8-520c4086f127 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.857113 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-d1208460-0544-4e40-bca7-99735bb96d99 req-d44d7bee-07fa-4253-8af8-520c4086f127 service nova] Creating event network-vif-deleted:d53cfc38-6644-4e13-ba09-d9d83433beb7 for instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb on hv-cinder-84713 Jun 24 08:44:56.862954 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-d1208460-0544-4e40-bca7-99735bb96d99 req-d44d7bee-07fa-4253-8af8-520c4086f127 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Jun 24 08:44:56.863568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 282/563] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:57.518119 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:57.518847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: f0e7e4cb-0993-46e3-b314-6a7a8850a4eb] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:57.526064 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:57.526636 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.527684 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:57.528345 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.544948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] HTTP exception thrown: Instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb could not be found. Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Request method failure captured: Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb HTTP/1.1 Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXk7L1V6FNjfD6Gwl0n6pLp_esdpPwuPw7rpWcRDvGYFX6fjScUa1u9YbphrQCFLGYnSg8XVg2Ap9aokJZaSnQkZgyjcMGvkbEzBrQ02RZUOvbkMZxjFLSZQKNZCwV0FH3wztvc1QsMQqapWDoqSBPFBBNlb-eeJR7A6_VQ-nfiXTSQ Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 84c244fc43f94ea2bc9f76965c111e78 Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotTestJSON-10493388 Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:44:57.547276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/84c244fc43f94ea2bc9f76965c111e78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/84c244fc43f94ea2bc9f76965c111e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/84c244fc43f94ea2bc9f76965c111e78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_84c244fc43f94ea2bc9f76965c111e78", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotTestJSON-10493388 Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 84c244fc43f94ea2bc9f76965c111e78 Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-10493388 Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotTestJSON-10493388-project Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 2039bddb840c4ac784f0b1c52326c79f Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotTestJSON-10493388-project Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb could not be found. Jun 24 08:44:57.548866 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'f0e7e4cb-0993-46e3-b314-6a7a8850a4eb'} Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb could not be found. Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:44:57.549735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb could not be found. Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb could not be found. Jun 24 08:44:57.551034 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:57.552085 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Returning 404 to user: Instance f0e7e4cb-0993-46e3-b314-6a7a8850a4eb could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:44:57.552085 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e6b68d6b-4a32-4dfc-8390-b251e90607a5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb" status: 404 len: 111 microversion: 2.1 time: 0.035799 Jun 24 08:44:57.552085 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 282/564] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:57 2022] GET /compute/v2.1/servers/f0e7e4cb-0993-46e3-b314-6a7a8850a4eb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:45:06.527282 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1898044665", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "networks": [{"uuid": "943a828b-ef50-4d2e-9324-0233b619718b"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:06.581139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] validate_networks() for [('943a828b-ef50-4d2e-9324-0233b619718b', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:45:06.847913 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:06.947038 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:45:06.947402 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:45:06.947872 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:45:06.948282 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:45:06.948688 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:45:06.958302 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:06.958759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:06.959582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:06.960013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:06.978116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Getting quotas for project 84c244fc43f94ea2bc9f76965c111e78. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:45:06.982026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Getting quotas for user 2039bddb840c4ac784f0b1c52326c79f and project 84c244fc43f94ea2bc9f76965c111e78. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:45:06.992806 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:45:06.995175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:45:07.047191 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5c1f480f-5356-4192-802c-9441df538210 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524473 Jun 24 08:45:07.048088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 283/565] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:45:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:45:07.058569 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-572416a5-00be-4583-8adc-61080181b508 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:07.059578 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-572416a5-00be-4583-8adc-61080181b508 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:07.119152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-572416a5-00be-4583-8adc-61080181b508 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:07.126635 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-572416a5-00be-4583-8adc-61080181b508 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1219 microversion: 2.1 time: 0.072202 Jun 24 08:45:07.127231 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 283/566] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:07 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:08.145376 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-52aec0db-f533-46b5-a5f5-98aac7f911d2 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:08.146042 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-52aec0db-f533-46b5-a5f5-98aac7f911d2 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:08.152870 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52aec0db-f533-46b5-a5f5-98aac7f911d2 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:08.153318 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52aec0db-f533-46b5-a5f5-98aac7f911d2 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:08.154132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52aec0db-f533-46b5-a5f5-98aac7f911d2 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:08.154568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52aec0db-f533-46b5-a5f5-98aac7f911d2 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:08.234905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-52aec0db-f533-46b5-a5f5-98aac7f911d2 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:08.243093 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-52aec0db-f533-46b5-a5f5-98aac7f911d2 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1271 microversion: 2.1 time: 0.103195 Jun 24 08:45:08.244069 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 284/567] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:08 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:09.261354 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-52c1e660-e11b-481b-94d4-41b94f9ca193 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:09.262759 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-52c1e660-e11b-481b-94d4-41b94f9ca193 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:09.266163 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:09.272198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52c1e660-e11b-481b-94d4-41b94f9ca193 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:09.272965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52c1e660-e11b-481b-94d4-41b94f9ca193 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:09.273994 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52c1e660-e11b-481b-94d4-41b94f9ca193 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:09.274816 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52c1e660-e11b-481b-94d4-41b94f9ca193 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:09.516626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-52c1e660-e11b-481b-94d4-41b94f9ca193 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:09.524141 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-52c1e660-e11b-481b-94d4-41b94f9ca193 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1319 microversion: 2.1 time: 0.267417 Jun 24 08:45:09.524710 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 284/568] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:09 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:09.725609 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-08d1be7b-8c3d-4530-a160-b0cca344e335 req-973548fb-8277-4f5f-9702-e563475f3960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a824c83-e930-4697-a539-9888e8be39a4", "tag": "ac5a6d4f-5b28-4778-959c-d049871f46e5"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:09.751641 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-08d1be7b-8c3d-4530-a160-b0cca344e335 req-973548fb-8277-4f5f-9702-e563475f3960 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:09.752088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-08d1be7b-8c3d-4530-a160-b0cca344e335 req-973548fb-8277-4f5f-9702-e563475f3960 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:09.765678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-08d1be7b-8c3d-4530-a160-b0cca344e335 req-973548fb-8277-4f5f-9702-e563475f3960 service nova] Creating event network-changed:ac5a6d4f-5b28-4778-959c-d049871f46e5 for instance 7a824c83-e930-4697-a539-9888e8be39a4 on hv-cinder-84713 Jun 24 08:45:09.771202 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-08d1be7b-8c3d-4530-a160-b0cca344e335 req-973548fb-8277-4f5f-9702-e563475f3960 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052020 Jun 24 08:45:09.774390 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 285/569] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:10.542805 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-567f58cb-29c7-4dc1-9ace-4f0a429fee1e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:10.543441 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-567f58cb-29c7-4dc1-9ace-4f0a429fee1e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:10.550831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-567f58cb-29c7-4dc1-9ace-4f0a429fee1e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:10.551274 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-567f58cb-29c7-4dc1-9ace-4f0a429fee1e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.552054 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-567f58cb-29c7-4dc1-9ace-4f0a429fee1e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:10.552487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-567f58cb-29c7-4dc1-9ace-4f0a429fee1e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.689287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-567f58cb-29c7-4dc1-9ace-4f0a429fee1e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:10.696883 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-567f58cb-29c7-4dc1-9ace-4f0a429fee1e tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1319 microversion: 2.1 time: 0.158106 Jun 24 08:45:10.697448 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 285/570] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:10 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:11.720542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae9114f6-5332-47f5-8d85-d1da690e3240 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:11.721900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ae9114f6-5332-47f5-8d85-d1da690e3240 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:11.734869 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae9114f6-5332-47f5-8d85-d1da690e3240 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:11.736379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae9114f6-5332-47f5-8d85-d1da690e3240 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:11.737834 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae9114f6-5332-47f5-8d85-d1da690e3240 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:11.738627 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae9114f6-5332-47f5-8d85-d1da690e3240 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:11.956180 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae9114f6-5332-47f5-8d85-d1da690e3240 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:11.966054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ae9114f6-5332-47f5-8d85-d1da690e3240 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1319 microversion: 2.1 time: 0.254858 Jun 24 08:45:11.966827 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 286/571] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:11 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:12.985114 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fa3d78cd-770f-41a5-9c01-1b3354b3713a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:12.986001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fa3d78cd-770f-41a5-9c01-1b3354b3713a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:12.992370 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fa3d78cd-770f-41a5-9c01-1b3354b3713a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:12.992815 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fa3d78cd-770f-41a5-9c01-1b3354b3713a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:12.993601 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fa3d78cd-770f-41a5-9c01-1b3354b3713a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:12.994063 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fa3d78cd-770f-41a5-9c01-1b3354b3713a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:13.179760 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fa3d78cd-770f-41a5-9c01-1b3354b3713a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:13.191452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fa3d78cd-770f-41a5-9c01-1b3354b3713a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1319 microversion: 2.1 time: 0.212055 Jun 24 08:45:13.192316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 286/572] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:12 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:14.209710 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-986b4a16-131c-49ce-b14e-63af6801b63a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:14.210437 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-986b4a16-131c-49ce-b14e-63af6801b63a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:14.216919 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-986b4a16-131c-49ce-b14e-63af6801b63a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.217365 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-986b4a16-131c-49ce-b14e-63af6801b63a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.218670 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-986b4a16-131c-49ce-b14e-63af6801b63a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.219107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-986b4a16-131c-49ce-b14e-63af6801b63a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.357045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-986b4a16-131c-49ce-b14e-63af6801b63a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:14.364969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-986b4a16-131c-49ce-b14e-63af6801b63a tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1319 microversion: 2.1 time: 0.159831 Jun 24 08:45:14.365564 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 287/573] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:14 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:15.026177 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9e9f040b-fc1b-4a68-96bf-224e50884a0c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b70e56b-d312-4042-8d02-69634e39295c"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:15.027316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9e9f040b-fc1b-4a68-96bf-224e50884a0c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:15.034279 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e9f040b-fc1b-4a68-96bf-224e50884a0c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.034740 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e9f040b-fc1b-4a68-96bf-224e50884a0c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.035542 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e9f040b-fc1b-4a68-96bf-224e50884a0c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.036200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e9f040b-fc1b-4a68-96bf-224e50884a0c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.056957 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-a1dcb664-f52c-438c-aea6-f10fcbdbc49e req-138621e6-058d-4b74-9ef5-77bfeca05a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a824c83-e930-4697-a539-9888e8be39a4", "name": "network-vif-plugged", "status": "completed", "tag": "ac5a6d4f-5b28-4778-959c-d049871f46e5"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:15.071770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a1dcb664-f52c-438c-aea6-f10fcbdbc49e req-138621e6-058d-4b74-9ef5-77bfeca05a97 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.072874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a1dcb664-f52c-438c-aea6-f10fcbdbc49e req-138621e6-058d-4b74-9ef5-77bfeca05a97 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.095830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-a1dcb664-f52c-438c-aea6-f10fcbdbc49e req-138621e6-058d-4b74-9ef5-77bfeca05a97 service nova] Creating event network-vif-plugged:ac5a6d4f-5b28-4778-959c-d049871f46e5 for instance 7a824c83-e930-4697-a539-9888e8be39a4 on hv-cinder-84713 Jun 24 08:45:15.104491 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-a1dcb664-f52c-438c-aea6-f10fcbdbc49e req-138621e6-058d-4b74-9ef5-77bfeca05a97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052810 Jun 24 08:45:15.105397 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 288/574] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:15.383567 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-76d6624b-c9ee-4654-9924-d14ee966aa2c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:15.384322 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-76d6624b-c9ee-4654-9924-d14ee966aa2c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:15.391612 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76d6624b-c9ee-4654-9924-d14ee966aa2c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.392152 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76d6624b-c9ee-4654-9924-d14ee966aa2c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.393045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76d6624b-c9ee-4654-9924-d14ee966aa2c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.393612 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76d6624b-c9ee-4654-9924-d14ee966aa2c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.409121 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9e9f040b-fc1b-4a68-96bf-224e50884a0c tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385857 Jun 24 08:45:15.410881 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 287/575] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:45:15 2022] POST /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:15.566537 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-76d6624b-c9ee-4654-9924-d14ee966aa2c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:15.573988 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-76d6624b-c9ee-4654-9924-d14ee966aa2c tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1319 microversion: 2.1 time: 0.195529 Jun 24 08:45:15.574564 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 289/576] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:15 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:16.591986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7f0690db-96b7-4763-bf86-6f066c970e58 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:16.592775 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7f0690db-96b7-4763-bf86-6f066c970e58 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:16.600499 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f0690db-96b7-4763-bf86-6f066c970e58 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:16.600944 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f0690db-96b7-4763-bf86-6f066c970e58 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:16.601735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f0690db-96b7-4763-bf86-6f066c970e58 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:16.602177 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f0690db-96b7-4763-bf86-6f066c970e58 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:16.748200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7f0690db-96b7-4763-bf86-6f066c970e58 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:16.757397 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7f0690db-96b7-4763-bf86-6f066c970e58 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1319 microversion: 2.1 time: 0.169531 Jun 24 08:45:16.757923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 288/577] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:16 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:17.776371 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c1eaacd4-0aaa-4754-9d97-cecd9ce5bc88 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:17.776371 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c1eaacd4-0aaa-4754-9d97-cecd9ce5bc88 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:17.779319 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:17.779319 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:17.787070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1eaacd4-0aaa-4754-9d97-cecd9ce5bc88 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:17.787775 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1eaacd4-0aaa-4754-9d97-cecd9ce5bc88 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:17.789001 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1eaacd4-0aaa-4754-9d97-cecd9ce5bc88 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:17.789716 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1eaacd4-0aaa-4754-9d97-cecd9ce5bc88 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:17.795105 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-57a6403a-ae26-40f9-8025-f927c2801776 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:17.797389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-57a6403a-ae26-40f9-8025-f927c2801776 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:17.800831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:17.809768 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-57a6403a-ae26-40f9-8025-f927c2801776 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:17.810502 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-57a6403a-ae26-40f9-8025-f927c2801776 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:17.811784 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-57a6403a-ae26-40f9-8025-f927c2801776 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:17.812533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-57a6403a-ae26-40f9-8025-f927c2801776 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:17.857736 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-57a6403a-ae26-40f9-8025-f927c2801776 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069371 Jun 24 08:45:17.859277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 289/578] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:45:17 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:45:17.934355 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b7ca452e-6102-4ad9-a2ad-ed6374d7140c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:17.935072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b7ca452e-6102-4ad9-a2ad-ed6374d7140c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:17.942337 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b7ca452e-6102-4ad9-a2ad-ed6374d7140c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:17.942860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b7ca452e-6102-4ad9-a2ad-ed6374d7140c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:17.944146 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b7ca452e-6102-4ad9-a2ad-ed6374d7140c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:17.944681 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b7ca452e-6102-4ad9-a2ad-ed6374d7140c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:17.964814 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c1eaacd4-0aaa-4754-9d97-cecd9ce5bc88 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:17.975710 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b7ca452e-6102-4ad9-a2ad-ed6374d7140c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:45:17.979295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c1eaacd4-0aaa-4754-9d97-cecd9ce5bc88 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1509 microversion: 2.1 time: 0.207874 Jun 24 08:45:17.980377 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 290/579] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:17 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:18.009785 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b60b4d2b-4318-4ef6-8bfe-161c55b61072 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71933eef-e855-432e-99b6-d188cbf7503c", "device": "/dev/sdb"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:18.011786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b60b4d2b-4318-4ef6-8bfe-161c55b61072 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:18.023126 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b60b4d2b-4318-4ef6-8bfe-161c55b61072 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.023849 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b60b4d2b-4318-4ef6-8bfe-161c55b61072 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.025132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b60b4d2b-4318-4ef6-8bfe-161c55b61072 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.025898 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b60b4d2b-4318-4ef6-8bfe-161c55b61072 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.066913 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b7ca452e-6102-4ad9-a2ad-ed6374d7140c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 204 len: 0 microversion: 2.1 time: 0.136887 Jun 24 08:45:18.067427 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 290/580] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:45:17 2022] DELETE /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:45:18.078421 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dcc53bfc-73cb-4004-a226-fb285eff7ec9 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:18.080344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dcc53bfc-73cb-4004-a226-fb285eff7ec9 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:18.088284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcc53bfc-73cb-4004-a226-fb285eff7ec9 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.088913 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcc53bfc-73cb-4004-a226-fb285eff7ec9 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.090096 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcc53bfc-73cb-4004-a226-fb285eff7ec9 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.090623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcc53bfc-73cb-4004-a226-fb285eff7ec9 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.249254 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dcc53bfc-73cb-4004-a226-fb285eff7ec9 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:18.258026 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dcc53bfc-73cb-4004-a226-fb285eff7ec9 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1673 microversion: 2.1 time: 0.184961 Jun 24 08:45:18.258637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 291/581] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:18 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:19.276814 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5ff8ebe6-0f08-4327-a0b9-52e411228b0c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:19.277575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5ff8ebe6-0f08-4327-a0b9-52e411228b0c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:19.284820 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ff8ebe6-0f08-4327-a0b9-52e411228b0c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:19.285273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ff8ebe6-0f08-4327-a0b9-52e411228b0c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:19.286090 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ff8ebe6-0f08-4327-a0b9-52e411228b0c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:19.286528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ff8ebe6-0f08-4327-a0b9-52e411228b0c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:19.432702 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5ff8ebe6-0f08-4327-a0b9-52e411228b0c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:19.441349 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5ff8ebe6-0f08-4327-a0b9-52e411228b0c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1673 microversion: 2.1 time: 0.168303 Jun 24 08:45:19.441957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 292/582] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:19 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:20.116423 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b60b4d2b-4318-4ef6-8bfe-161c55b61072 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "POST /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.114011 Jun 24 08:45:20.117054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 291/583] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:45:18 2022] POST /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4/os-volume_attachments => generated 194 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:20.458473 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2df35d95-f7a0-4dab-8476-6cc59c5eff4e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:20.459083 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2df35d95-f7a0-4dab-8476-6cc59c5eff4e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:20.465844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2df35d95-f7a0-4dab-8476-6cc59c5eff4e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:20.466287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2df35d95-f7a0-4dab-8476-6cc59c5eff4e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:20.467055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2df35d95-f7a0-4dab-8476-6cc59c5eff4e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:20.467489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2df35d95-f7a0-4dab-8476-6cc59c5eff4e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:20.696421 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2df35d95-f7a0-4dab-8476-6cc59c5eff4e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:20.705320 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2df35d95-f7a0-4dab-8476-6cc59c5eff4e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1673 microversion: 2.1 time: 0.250604 Jun 24 08:45:20.706225 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 293/584] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:20 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:21.291880 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5ba8bc0a-9399-4ed1-a532-5bb5df45d5c3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:21.292714 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5ba8bc0a-9399-4ed1-a532-5bb5df45d5c3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:21.299577 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc0a-9399-4ed1-a532-5bb5df45d5c3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.300086 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc0a-9399-4ed1-a532-5bb5df45d5c3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.300851 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc0a-9399-4ed1-a532-5bb5df45d5c3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.301468 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc0a-9399-4ed1-a532-5bb5df45d5c3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.335710 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5ba8bc0a-9399-4ed1-a532-5bb5df45d5c3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments/90b46f87-19e9-4a44-a3f8-003cb19f5eab" status: 200 len: 194 microversion: 2.20 time: 0.048459 Jun 24 08:45:21.338223 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 292/585] 10.222.0.13 () {60 vars in 1453 bytes} [Fri Jun 24 08:45:21 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments/90b46f87-19e9-4a44-a3f8-003cb19f5eab => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:45:21.411177 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0974b59e-b53e-4800-ab1e-75f1af4eb288 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:21.411674 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0974b59e-b53e-4800-ab1e-75f1af4eb288 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:21.417979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0974b59e-b53e-4800-ab1e-75f1af4eb288 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.418432 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0974b59e-b53e-4800-ab1e-75f1af4eb288 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.419297 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0974b59e-b53e-4800-ab1e-75f1af4eb288 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.419852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0974b59e-b53e-4800-ab1e-75f1af4eb288 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.521869 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-0974b59e-b53e-4800-ab1e-75f1af4eb288 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lazy-loading 'services' on Instance uuid 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:21.640619 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0974b59e-b53e-4800-ab1e-75f1af4eb288 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments/90b46f87-19e9-4a44-a3f8-003cb19f5eab" status: 202 len: 0 microversion: 2.20 time: 0.233275 Jun 24 08:45:21.641595 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 294/586] 10.222.0.13 () {60 vars in 1456 bytes} [Fri Jun 24 08:45:21 2022] DELETE /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments/90b46f87-19e9-4a44-a3f8-003cb19f5eab => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:45:21.653894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-da094205-bbae-43a5-9c38-e493d43fe8ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:21.656184 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-da094205-bbae-43a5-9c38-e493d43fe8ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:21.664794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da094205-bbae-43a5-9c38-e493d43fe8ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.665378 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da094205-bbae-43a5-9c38-e493d43fe8ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.666389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da094205-bbae-43a5-9c38-e493d43fe8ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.666903 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da094205-bbae-43a5-9c38-e493d43fe8ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.701505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-da094205-bbae-43a5-9c38-e493d43fe8ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055075 Jun 24 08:45:21.702810 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 293/587] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:21 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:21.725086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b7578fe9-9f56-42a0-9ce9-0b5cdcbcc0fc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:21.725821 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b7578fe9-9f56-42a0-9ce9-0b5cdcbcc0fc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:21.732538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b7578fe9-9f56-42a0-9ce9-0b5cdcbcc0fc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.733273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b7578fe9-9f56-42a0-9ce9-0b5cdcbcc0fc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.734350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b7578fe9-9f56-42a0-9ce9-0b5cdcbcc0fc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.734944 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b7578fe9-9f56-42a0-9ce9-0b5cdcbcc0fc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.875605 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b7578fe9-9f56-42a0-9ce9-0b5cdcbcc0fc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:21.887204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b7578fe9-9f56-42a0-9ce9-0b5cdcbcc0fc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1605 microversion: 2.1 time: 0.166896 Jun 24 08:45:21.901958 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 295/588] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:21 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:21.903059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-8bf07bc2-8514-4df6-91d9-02130fae7327 req-f38a2db2-e67d-422c-b543-b55f8b99679e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5d35ce-c7be-407a-a48d-ef65f3133dbc", "name": "network-vif-deleted", "tag": "5263720a-56c1-460b-8d53-95927806ac6a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:21.914835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8bf07bc2-8514-4df6-91d9-02130fae7327 req-f38a2db2-e67d-422c-b543-b55f8b99679e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.914835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8bf07bc2-8514-4df6-91d9-02130fae7327 req-f38a2db2-e67d-422c-b543-b55f8b99679e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.926571 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-8bf07bc2-8514-4df6-91d9-02130fae7327 req-f38a2db2-e67d-422c-b543-b55f8b99679e service nova] Creating event network-vif-deleted:5263720a-56c1-460b-8d53-95927806ac6a for instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc on hv-cinder-84713 Jun 24 08:45:21.932070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-8bf07bc2-8514-4df6-91d9-02130fae7327 req-f38a2db2-e67d-422c-b543-b55f8b99679e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050071 Jun 24 08:45:21.933008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 294/589] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:22.715948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-850240c4-5272-4491-8464-08c4a6a591e9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:22.718705 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-850240c4-5272-4491-8464-08c4a6a591e9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:22.721740 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:22.731412 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-850240c4-5272-4491-8464-08c4a6a591e9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:22.732710 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-850240c4-5272-4491-8464-08c4a6a591e9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:22.734909 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-850240c4-5272-4491-8464-08c4a6a591e9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:22.735609 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-850240c4-5272-4491-8464-08c4a6a591e9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:22.774585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:22.780376 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-850240c4-5272-4491-8464-08c4a6a591e9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069128 Jun 24 08:45:22.781393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 296/590] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:22 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:22.914760 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:22.934482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:22.950303 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:22.951050 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:22.953224 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:22.954604 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.011672 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.012122 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.012580 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lazy-loading 'fault' on Instance uuid 0d5d35ce-c7be-407a-a48d-ef65f3133dbc {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:23.128012 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:23.157102 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-89ba63b8-8e9c-4973-bd4d-5c8349561d76 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 200 len: 1326 microversion: 2.1 time: 0.248955 Jun 24 08:45:23.158081 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 295/591] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:22 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:23.792233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-52d3ea06-3ba9-48a7-8e4d-e37615bda48c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:23.793190 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-52d3ea06-3ba9-48a7-8e4d-e37615bda48c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:23.802317 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52d3ea06-3ba9-48a7-8e4d-e37615bda48c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.802756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52d3ea06-3ba9-48a7-8e4d-e37615bda48c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.803530 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52d3ea06-3ba9-48a7-8e4d-e37615bda48c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.803957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52d3ea06-3ba9-48a7-8e4d-e37615bda48c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.836902 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-52d3ea06-3ba9-48a7-8e4d-e37615bda48c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048610 Jun 24 08:45:23.837489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 297/592] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:23 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:24.176184 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:24.176890 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:24.179567 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:24.189230 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.189858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.190702 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.191203 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.192096 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-eded45eb-9186-434d-9c79-3919ad0198d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:24.193206 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-eded45eb-9186-434d-9c79-3919ad0198d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:24.201292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eded45eb-9186-434d-9c79-3919ad0198d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.202307 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eded45eb-9186-434d-9c79-3919ad0198d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.203191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eded45eb-9186-434d-9c79-3919ad0198d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.203606 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eded45eb-9186-434d-9c79-3919ad0198d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.208864 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] HTTP exception thrown: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Request method failure captured: Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc HTTP/1.1 Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiROebkf1QCea3YVodDpKh-is4p5qLxKDLYCitbrUiGHFx2WqeKpQcpQftUKpeSnCljbVtENK_PztSqjnxwOJA3A-3jWaF4bMc7tSslSE9_6qfDD95T0B2Xwlkk31c8_4KGoS6_WY_TerU67VW8P3U-3yucGNKqnickPVVDyfz1rMw Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:45:24.210632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2988ac4c59124e02bbcc7049e69dd599", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 71cbad05d1a54b4b9959e2ebbcb720fd Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:45:24.213052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '0d5d35ce-c7be-407a-a48d-ef65f3133dbc'} Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:45:24.214811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:45:24.217295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:45:24.220208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Returning 404 to user: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:45:24.220208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-56662c42-0971-4284-b4a1-189775924dca tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 404 len: 111 microversion: 2.1 time: 0.041000 Jun 24 08:45:24.220208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 296/593] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:24 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:45:24.222189 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b8b371f3-80b9-4f06-9b0c-c8be97be37f4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '.version_select at 0x7f0a7c87e820>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:24.228253 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-eded45eb-9186-434d-9c79-3919ad0198d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lazy-loading 'flavor' on Instance uuid 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:24.264936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b8b371f3-80b9-4f06-9b0c-c8be97be37f4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525560488" status: 202 len: 0 microversion: 2.1 time: 0.046154 Jun 24 08:45:24.265351 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 297/594] 10.222.0.13 () {58 vars in 1220 bytes} [Fri Jun 24 08:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525560488 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:45:24.385525 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-eded45eb-9186-434d-9c79-3919ad0198d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/action" status: 200 len: 32 microversion: 2.1 time: 0.198341 Jun 24 08:45:24.386187 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 298/595] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:45:24 2022] POST /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:45:24.401910 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-563023a4-a439-4c4a-8832-429fb3e85bb6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:24.403169 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-563023a4-a439-4c4a-8832-429fb3e85bb6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:24.415734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-563023a4-a439-4c4a-8832-429fb3e85bb6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.416255 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-563023a4-a439-4c4a-8832-429fb3e85bb6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.417330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-563023a4-a439-4c4a-8832-429fb3e85bb6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.418011 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-563023a4-a439-4c4a-8832-429fb3e85bb6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.741747 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-563023a4-a439-4c4a-8832-429fb3e85bb6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:24.752396 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-563023a4-a439-4c4a-8832-429fb3e85bb6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.358011 Jun 24 08:45:24.759170 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 298/596] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:24 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:24.851117 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c2b230ac-a012-4e90-b82d-d34351edb30c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:24.853832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c2b230ac-a012-4e90-b82d-d34351edb30c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:24.865142 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c2b230ac-a012-4e90-b82d-d34351edb30c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.866097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c2b230ac-a012-4e90-b82d-d34351edb30c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.868189 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c2b230ac-a012-4e90-b82d-d34351edb30c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.868914 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c2b230ac-a012-4e90-b82d-d34351edb30c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.905474 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c2b230ac-a012-4e90-b82d-d34351edb30c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060110 Jun 24 08:45:24.907232 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 299/597] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:24 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:25.095916 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7af023bc-a1dc-4974-b56a-ae505541d002 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'create', calling method: .version_select at 0x7f0a7c7ce1f0>, body: {"keypair": {"name": "tempest-keypair-801070813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcguoyc2NEUbTKtDh7afzShuQExOTHD8tuEesgsEys77R0oPlJWDZwx6MQisBTUIWf8WX/L0TgxroeoL9d5Y3llDmuskHu3FFTlc7Wrf0YbWVroFqcuBBJPiBq1pPWVDg=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:25.117025 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-7af023bc-a1dc-4974-b56a-ae505541d002 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Getting quotas for project 2988ac4c59124e02bbcc7049e69dd599. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:45:25.121108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-7af023bc-a1dc-4974-b56a-ae505541d002 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Getting quotas for user 71cbad05d1a54b4b9959e2ebbcb720fd and project 2988ac4c59124e02bbcc7049e69dd599. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:45:25.147423 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7af023bc-a1dc-4974-b56a-ae505541d002 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055405 Jun 24 08:45:25.148140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 299/598] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:45:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:25.771208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5d56a181-8945-4a8c-b89c-072c135d87ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:25.771925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5d56a181-8945-4a8c-b89c-072c135d87ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:25.777991 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5d56a181-8945-4a8c-b89c-072c135d87ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.778541 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5d56a181-8945-4a8c-b89c-072c135d87ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.779316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5d56a181-8945-4a8c-b89c-072c135d87ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.779746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5d56a181-8945-4a8c-b89c-072c135d87ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.921990 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e147b93b-ea9c-49ad-a737-ff330e391258 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:25.923213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e147b93b-ea9c-49ad-a737-ff330e391258 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:25.926223 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5d56a181-8945-4a8c-b89c-072c135d87ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:25.929991 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e147b93b-ea9c-49ad-a737-ff330e391258 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.930734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e147b93b-ea9c-49ad-a737-ff330e391258 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.931639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e147b93b-ea9c-49ad-a737-ff330e391258 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.932174 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e147b93b-ea9c-49ad-a737-ff330e391258 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.935162 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5d56a181-8945-4a8c-b89c-072c135d87ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.167813 Jun 24 08:45:25.936081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 300/599] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:25 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:25.971074 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e147b93b-ea9c-49ad-a737-ff330e391258 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054585 Jun 24 08:45:25.972083 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 300/600] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:25 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:45:26.540008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-294977971", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf6a6a42-9d4a-4d09-bce3-6aaa73db62b6"}], "security_groups": [{"name": "tempest-securitygroup--1074366162"}], "key_name": "tempest-keypair-801070813", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:26.641213 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] validate_networks() for [('cf6a6a42-9d4a-4d09-bce3-6aaa73db62b6', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:45:26.953459 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-37859c19-9233-4dd6-aba7-4ed015d3b514 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:26.954115 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-37859c19-9233-4dd6-aba7-4ed015d3b514 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:26.960574 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37859c19-9233-4dd6-aba7-4ed015d3b514 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:26.961023 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37859c19-9233-4dd6-aba7-4ed015d3b514 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:26.961834 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37859c19-9233-4dd6-aba7-4ed015d3b514 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:26.962273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37859c19-9233-4dd6-aba7-4ed015d3b514 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.067975 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:45:27.068475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:45:27.068861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:45:27.069267 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:45:27.069677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:45:27.080486 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.080909 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.081733 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.082176 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.099997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Getting quotas for project 2988ac4c59124e02bbcc7049e69dd599. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:45:27.104078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Getting quotas for user 71cbad05d1a54b4b9959e2ebbcb720fd and project 2988ac4c59124e02bbcc7049e69dd599. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:45:27.116669 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:45:27.119075 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:45:27.134904 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-37859c19-9233-4dd6-aba7-4ed015d3b514 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:27.143324 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-37859c19-9233-4dd6-aba7-4ed015d3b514 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.194299 Jun 24 08:45:27.143909 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 301/601] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:26 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:27.154458 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-880e67f3-5ba3-4c20-b54d-2ed27bd8c798 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:27.156163 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-880e67f3-5ba3-4c20-b54d-2ed27bd8c798 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:27.162846 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-880e67f3-5ba3-4c20-b54d-2ed27bd8c798 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.163297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-880e67f3-5ba3-4c20-b54d-2ed27bd8c798 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.164133 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-880e67f3-5ba3-4c20-b54d-2ed27bd8c798 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.164570 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-880e67f3-5ba3-4c20-b54d-2ed27bd8c798 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.172406 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f90f632b-832a-4675-be29-d321b2e5b13f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.636572 Jun 24 08:45:27.173369 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 301/602] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:45:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:45:27.183197 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e51ab50e-7e07-427d-870c-8180a9bd2aa8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:27.183807 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e51ab50e-7e07-427d-870c-8180a9bd2aa8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:27.199380 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-880e67f3-5ba3-4c20-b54d-2ed27bd8c798 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049925 Jun 24 08:45:27.200099 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 302/603] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:27 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:27.242938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e51ab50e-7e07-427d-870c-8180a9bd2aa8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:27.251348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e51ab50e-7e07-427d-870c-8180a9bd2aa8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1236 microversion: 2.1 time: 0.072118 Jun 24 08:45:27.251932 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 302/604] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:27 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:28.160734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-905c1f8f-dc66-44b3-9050-6722e6619240 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:28.161342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-905c1f8f-dc66-44b3-9050-6722e6619240 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:28.167868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-905c1f8f-dc66-44b3-9050-6722e6619240 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.168316 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-905c1f8f-dc66-44b3-9050-6722e6619240 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.169059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-905c1f8f-dc66-44b3-9050-6722e6619240 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.169489 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-905c1f8f-dc66-44b3-9050-6722e6619240 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.174135 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:28.212566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c1ea08b9-f061-4459-bebc-5aff66d3c794 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:28.213555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c1ea08b9-f061-4459-bebc-5aff66d3c794 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:28.222412 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1ea08b9-f061-4459-bebc-5aff66d3c794 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.222861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1ea08b9-f061-4459-bebc-5aff66d3c794 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.223643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1ea08b9-f061-4459-bebc-5aff66d3c794 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.224233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1ea08b9-f061-4459-bebc-5aff66d3c794 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.256618 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c1ea08b9-f061-4459-bebc-5aff66d3c794 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047942 Jun 24 08:45:28.257469 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 303/605] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:28 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:45:28.268595 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bef020c2-1653-4a9a-a08e-b39cb9e97543 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:28.269209 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bef020c2-1653-4a9a-a08e-b39cb9e97543 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:28.275527 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bef020c2-1653-4a9a-a08e-b39cb9e97543 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.275967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bef020c2-1653-4a9a-a08e-b39cb9e97543 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.276738 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bef020c2-1653-4a9a-a08e-b39cb9e97543 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.277269 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bef020c2-1653-4a9a-a08e-b39cb9e97543 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.381626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bef020c2-1653-4a9a-a08e-b39cb9e97543 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:28.390825 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bef020c2-1653-4a9a-a08e-b39cb9e97543 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1296 microversion: 2.1 time: 0.126435 Jun 24 08:45:28.400817 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-905c1f8f-dc66-44b3-9050-6722e6619240 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:28.401443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 304/606] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:28 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1296 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:28.410121 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-905c1f8f-dc66-44b3-9050-6722e6619240 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.253060 Jun 24 08:45:28.410851 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 303/607] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:28 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:29.269164 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4a219a60-b01a-405c-9ca1-1a9531f8f9ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:29.270112 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4a219a60-b01a-405c-9ca1-1a9531f8f9ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:29.276835 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a219a60-b01a-405c-9ca1-1a9531f8f9ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.277277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a219a60-b01a-405c-9ca1-1a9531f8f9ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.278086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a219a60-b01a-405c-9ca1-1a9531f8f9ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.278522 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a219a60-b01a-405c-9ca1-1a9531f8f9ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.310613 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4a219a60-b01a-405c-9ca1-1a9531f8f9ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046585 Jun 24 08:45:29.311737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 305/608] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:29 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:29.409176 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e94ca721-796a-4964-8bb2-52a06621536d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:29.409811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e94ca721-796a-4964-8bb2-52a06621536d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:29.416581 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e94ca721-796a-4964-8bb2-52a06621536d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.417025 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e94ca721-796a-4964-8bb2-52a06621536d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.417843 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e94ca721-796a-4964-8bb2-52a06621536d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.418274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e94ca721-796a-4964-8bb2-52a06621536d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.429135 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-727b44fa-13e0-46ba-885b-200a2ca1f728 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:29.430054 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-727b44fa-13e0-46ba-885b-200a2ca1f728 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:29.437441 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-727b44fa-13e0-46ba-885b-200a2ca1f728 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.438143 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-727b44fa-13e0-46ba-885b-200a2ca1f728 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.439093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-727b44fa-13e0-46ba-885b-200a2ca1f728 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.439690 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-727b44fa-13e0-46ba-885b-200a2ca1f728 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.687887 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-727b44fa-13e0-46ba-885b-200a2ca1f728 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:29.698120 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-727b44fa-13e0-46ba-885b-200a2ca1f728 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.273003 Jun 24 08:45:29.698716 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 306/609] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:29 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:29.708588 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e94ca721-796a-4964-8bb2-52a06621536d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:29.716106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e94ca721-796a-4964-8bb2-52a06621536d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.311681 Jun 24 08:45:29.716748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 304/610] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:29 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:30.323103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-33cd8e98-f4e5-4823-b626-053c6ac9dff9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:30.324765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-33cd8e98-f4e5-4823-b626-053c6ac9dff9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:30.346788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-a241bfd7-ee80-41d1-b364-8919b674aeac req-7f5fab53-06d9-4963-9933-2fca202c2243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d400a3a2-9cc2-4ce5-959c-e45d459b58a9", "tag": "c281cf91-0715-4eb4-ba74-fb499c317db3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:30.362873 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a241bfd7-ee80-41d1-b364-8919b674aeac req-7f5fab53-06d9-4963-9933-2fca202c2243 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.366488 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-33cd8e98-f4e5-4823-b626-053c6ac9dff9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.367038 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-33cd8e98-f4e5-4823-b626-053c6ac9dff9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.373321 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a241bfd7-ee80-41d1-b364-8919b674aeac req-7f5fab53-06d9-4963-9933-2fca202c2243 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.374196 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-33cd8e98-f4e5-4823-b626-053c6ac9dff9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.375698 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-33cd8e98-f4e5-4823-b626-053c6ac9dff9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.387953 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-a241bfd7-ee80-41d1-b364-8919b674aeac req-7f5fab53-06d9-4963-9933-2fca202c2243 service nova] Creating event network-changed:c281cf91-0715-4eb4-ba74-fb499c317db3 for instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 on hv-cinder-84713 Jun 24 08:45:30.393666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-a241bfd7-ee80-41d1-b364-8919b674aeac req-7f5fab53-06d9-4963-9933-2fca202c2243 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052404 Jun 24 08:45:30.394301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 305/611] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:30.409679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-33cd8e98-f4e5-4823-b626-053c6ac9dff9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091568 Jun 24 08:45:30.410300 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 307/612] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:30 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:30.716636 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-67a00f6a-e480-4659-8eca-864740fead41 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:30.717905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-67a00f6a-e480-4659-8eca-864740fead41 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:30.724478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67a00f6a-e480-4659-8eca-864740fead41 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.724919 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67a00f6a-e480-4659-8eca-864740fead41 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.725719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67a00f6a-e480-4659-8eca-864740fead41 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.726146 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67a00f6a-e480-4659-8eca-864740fead41 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.732317 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-38ec9376-7c51-4b7d-befe-d6fc727cf6dc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:30.733617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-38ec9376-7c51-4b7d-befe-d6fc727cf6dc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:30.739801 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-38ec9376-7c51-4b7d-befe-d6fc727cf6dc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.740248 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-38ec9376-7c51-4b7d-befe-d6fc727cf6dc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.741019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-38ec9376-7c51-4b7d-befe-d6fc727cf6dc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.741460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-38ec9376-7c51-4b7d-befe-d6fc727cf6dc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.933897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-67a00f6a-e480-4659-8eca-864740fead41 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:30.938331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-38ec9376-7c51-4b7d-befe-d6fc727cf6dc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:30.942711 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-67a00f6a-e480-4659-8eca-864740fead41 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.230871 Jun 24 08:45:30.943300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 306/613] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:30 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:30.945787 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-38ec9376-7c51-4b7d-befe-d6fc727cf6dc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.217228 Jun 24 08:45:30.946534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 308/614] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:30 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:31.421606 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-58b4e5b4-59cd-4b60-802d-b8b70793c551 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:31.422632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-58b4e5b4-59cd-4b60-802d-b8b70793c551 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:31.428773 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58b4e5b4-59cd-4b60-802d-b8b70793c551 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:31.429222 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58b4e5b4-59cd-4b60-802d-b8b70793c551 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.430012 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58b4e5b4-59cd-4b60-802d-b8b70793c551 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:31.430446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58b4e5b4-59cd-4b60-802d-b8b70793c551 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.459127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-58b4e5b4-59cd-4b60-802d-b8b70793c551 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042206 Jun 24 08:45:31.459704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 307/615] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:31 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:31.960816 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1a066285-f2bb-4cc1-84cd-ca8af73c4e17 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:31.961421 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1a066285-f2bb-4cc1-84cd-ca8af73c4e17 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:31.962823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0e090124-e5f6-4862-8820-589f33272fb0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:31.963445 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0e090124-e5f6-4862-8820-589f33272fb0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:31.968271 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1a066285-f2bb-4cc1-84cd-ca8af73c4e17 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:31.968720 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1a066285-f2bb-4cc1-84cd-ca8af73c4e17 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.969467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1a066285-f2bb-4cc1-84cd-ca8af73c4e17 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:31.969932 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1a066285-f2bb-4cc1-84cd-ca8af73c4e17 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.970224 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e090124-e5f6-4862-8820-589f33272fb0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:31.970672 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e090124-e5f6-4862-8820-589f33272fb0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.971466 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e090124-e5f6-4862-8820-589f33272fb0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:31.971900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e090124-e5f6-4862-8820-589f33272fb0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:32.360203 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1a066285-f2bb-4cc1-84cd-ca8af73c4e17 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:32.363241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0e090124-e5f6-4862-8820-589f33272fb0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:32.369775 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1a066285-f2bb-4cc1-84cd-ca8af73c4e17 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.411714 Jun 24 08:45:32.369775 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 309/616] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:31 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:32.371388 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0e090124-e5f6-4862-8820-589f33272fb0 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.412190 Jun 24 08:45:32.372041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 308/617] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:31 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:32.471139 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1cf894fa-2a4b-4fe4-82f6-d536b5208200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:32.472076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1cf894fa-2a4b-4fe4-82f6-d536b5208200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:32.478445 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1cf894fa-2a4b-4fe4-82f6-d536b5208200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:32.478894 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1cf894fa-2a4b-4fe4-82f6-d536b5208200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:32.479684 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1cf894fa-2a4b-4fe4-82f6-d536b5208200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:32.480122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1cf894fa-2a4b-4fe4-82f6-d536b5208200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:32.513196 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1cf894fa-2a4b-4fe4-82f6-d536b5208200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046201 Jun 24 08:45:32.513802 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 310/618] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:32 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:33.388060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-60742cfa-5deb-4759-a18f-4d1d7c5063ee tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:33.388617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bef074c3-6788-465c-9d81-b88522a04e2b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:33.388960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-60742cfa-5deb-4759-a18f-4d1d7c5063ee tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:33.389261 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bef074c3-6788-465c-9d81-b88522a04e2b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:33.395825 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60742cfa-5deb-4759-a18f-4d1d7c5063ee tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.396379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60742cfa-5deb-4759-a18f-4d1d7c5063ee tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.397435 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60742cfa-5deb-4759-a18f-4d1d7c5063ee tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.397785 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bef074c3-6788-465c-9d81-b88522a04e2b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.397931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60742cfa-5deb-4759-a18f-4d1d7c5063ee tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.398557 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bef074c3-6788-465c-9d81-b88522a04e2b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.399343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bef074c3-6788-465c-9d81-b88522a04e2b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.399777 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bef074c3-6788-465c-9d81-b88522a04e2b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.689560 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-60742cfa-5deb-4759-a18f-4d1d7c5063ee tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:33.693733 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bef074c3-6788-465c-9d81-b88522a04e2b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:33.698866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-60742cfa-5deb-4759-a18f-4d1d7c5063ee tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.314742 Jun 24 08:45:33.699767 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 309/619] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:33 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:33.702440 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bef074c3-6788-465c-9d81-b88522a04e2b tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.317360 Jun 24 08:45:33.706455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1e84d087-f6da-4047-9078-06618c15a6c5 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:33.707810 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1e84d087-f6da-4047-9078-06618c15a6c5 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:33.712265 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 311/620] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:33 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:33.716396 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e84d087-f6da-4047-9078-06618c15a6c5 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.717054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e84d087-f6da-4047-9078-06618c15a6c5 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.718229 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e84d087-f6da-4047-9078-06618c15a6c5 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.718845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e84d087-f6da-4047-9078-06618c15a6c5 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.756141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1e84d087-f6da-4047-9078-06618c15a6c5 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054868 Jun 24 08:45:33.756760 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 310/621] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:45:33 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:33.819477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-71cb4780-18bb-4d9d-830f-7472b7003ad2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:33.819976 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-71cb4780-18bb-4d9d-830f-7472b7003ad2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:33.826236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-71cb4780-18bb-4d9d-830f-7472b7003ad2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.827231 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-71cb4780-18bb-4d9d-830f-7472b7003ad2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.828020 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-71cb4780-18bb-4d9d-830f-7472b7003ad2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.828452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-71cb4780-18bb-4d9d-830f-7472b7003ad2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.855615 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-71cb4780-18bb-4d9d-830f-7472b7003ad2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:45:33.869776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:33.949016 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-71cb4780-18bb-4d9d-830f-7472b7003ad2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 204 len: 0 microversion: 2.20 time: 0.133167 Jun 24 08:45:33.949593 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 312/622] 10.222.0.13 () {60 vars in 1279 bytes} [Fri Jun 24 08:45:33 2022] DELETE /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:45:33.958152 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:33.958919 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:33.965266 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.965744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.966494 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.966929 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.100372 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:34.108942 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:34.110702 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:34.111868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a2591f37-8a20-42b1-a0f2-1adf8cbbd9ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.157625 Jun 24 08:45:34.112430 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 311/623] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:33 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:34.718781 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b903d8ee-f938-4e8f-8989-1e0127d041d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:34.719485 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b903d8ee-f938-4e8f-8989-1e0127d041d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:34.719814 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4e992ac4-98c6-4b4e-a3a3-3f7192d437df tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:34.720421 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4e992ac4-98c6-4b4e-a3a3-3f7192d437df tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:34.726133 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b903d8ee-f938-4e8f-8989-1e0127d041d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.726584 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b903d8ee-f938-4e8f-8989-1e0127d041d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.726901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e992ac4-98c6-4b4e-a3a3-3f7192d437df tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.727341 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e992ac4-98c6-4b4e-a3a3-3f7192d437df tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.727447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b903d8ee-f938-4e8f-8989-1e0127d041d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.727778 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b903d8ee-f938-4e8f-8989-1e0127d041d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.728090 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e992ac4-98c6-4b4e-a3a3-3f7192d437df tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.728527 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e992ac4-98c6-4b4e-a3a3-3f7192d437df tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:35.128868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:35.185736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4e992ac4-98c6-4b4e-a3a3-3f7192d437df tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:35.193905 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b903d8ee-f938-4e8f-8989-1e0127d041d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:35.194452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4e992ac4-98c6-4b4e-a3a3-3f7192d437df tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.478820 Jun 24 08:45:35.197506 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 312/624] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:34 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:35.202487 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:35.203101 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:35.207296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b903d8ee-f938-4e8f-8989-1e0127d041d5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.493532 Jun 24 08:45:35.208012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 313/625] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:34 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:35.209186 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:35.209641 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:35.210509 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:35.210946 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:35.351563 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:35.360436 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:35.362022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:35.363297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-84c3c8ca-a5cd-415a-85a6-c59bd6525608 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.164770 Jun 24 08:45:35.363899 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 313/626] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:35 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:36.212108 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b486c1be-2111-45a0-8035-90dfb4908b42 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:36.212729 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b486c1be-2111-45a0-8035-90dfb4908b42 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:36.219493 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b486c1be-2111-45a0-8035-90dfb4908b42 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.219940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b486c1be-2111-45a0-8035-90dfb4908b42 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.220710 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b486c1be-2111-45a0-8035-90dfb4908b42 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.221146 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b486c1be-2111-45a0-8035-90dfb4908b42 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.225049 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a221c1b1-3e77-425c-8b76-9f7f84701236 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:36.225759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a221c1b1-3e77-425c-8b76-9f7f84701236 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:36.232237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a221c1b1-3e77-425c-8b76-9f7f84701236 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.233225 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a221c1b1-3e77-425c-8b76-9f7f84701236 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.234121 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a221c1b1-3e77-425c-8b76-9f7f84701236 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.234509 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a221c1b1-3e77-425c-8b76-9f7f84701236 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.438158 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b486c1be-2111-45a0-8035-90dfb4908b42 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.444630 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a221c1b1-3e77-425c-8b76-9f7f84701236 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.453505 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b486c1be-2111-45a0-8035-90dfb4908b42 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.245231 Jun 24 08:45:36.466006 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 314/627] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:36 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:36.466280 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a221c1b1-3e77-425c-8b76-9f7f84701236 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.239106 Jun 24 08:45:36.466477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:36.466477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:36.470534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.470534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.470534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.470534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.471621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 314/628] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:36 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:36.615910 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.625081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.626815 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.627948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2d3c8ffb-353d-491a-9d1c-a0bea369c42c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.170947 Jun 24 08:45:36.628575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 315/629] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:36 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:37.481775 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-69443b34-8730-4610-9375-b9e57d1322e1 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:37.482411 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-84ba0415-883d-45fd-b0d2-eb7f3955ca08 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:37.483106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-84ba0415-883d-45fd-b0d2-eb7f3955ca08 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:37.483276 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-69443b34-8730-4610-9375-b9e57d1322e1 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:37.485556 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:37.486775 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=8 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:37.492819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-69443b34-8730-4610-9375-b9e57d1322e1 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.493264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-69443b34-8730-4610-9375-b9e57d1322e1 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.493394 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84ba0415-883d-45fd-b0d2-eb7f3955ca08 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.493743 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84ba0415-883d-45fd-b0d2-eb7f3955ca08 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.494082 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-69443b34-8730-4610-9375-b9e57d1322e1 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.494502 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84ba0415-883d-45fd-b0d2-eb7f3955ca08 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.494607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-69443b34-8730-4610-9375-b9e57d1322e1 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.494934 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84ba0415-883d-45fd-b0d2-eb7f3955ca08 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.730066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-69443b34-8730-4610-9375-b9e57d1322e1 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.734101 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-84ba0415-883d-45fd-b0d2-eb7f3955ca08 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.739584 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-69443b34-8730-4610-9375-b9e57d1322e1 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.263305 Jun 24 08:45:37.739584 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 315/630] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:37 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:37.743970 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:37.745184 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:37.751970 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.752407 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.753178 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-84ba0415-883d-45fd-b0d2-eb7f3955ca08 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.275527 Jun 24 08:45:37.753344 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.753618 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.754136 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 316/631] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:37 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:37.893543 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.901992 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.903492 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.904776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d9cc934f-66c4-46cc-b751-99a5c92280e7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.165100 Jun 24 08:45:37.905632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 316/632] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:37 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:38.755989 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d876eccb-55b4-4031-9980-e887ec23539f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:38.756590 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d876eccb-55b4-4031-9980-e887ec23539f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:38.763047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d876eccb-55b4-4031-9980-e887ec23539f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.763797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d876eccb-55b4-4031-9980-e887ec23539f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.765416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d876eccb-55b4-4031-9980-e887ec23539f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.765855 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d876eccb-55b4-4031-9980-e887ec23539f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.771725 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e80d4962-941b-4f28-b5ab-a0a9c2bcd387 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:38.772416 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e80d4962-941b-4f28-b5ab-a0a9c2bcd387 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:38.778870 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e80d4962-941b-4f28-b5ab-a0a9c2bcd387 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.779335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e80d4962-941b-4f28-b5ab-a0a9c2bcd387 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.781096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e80d4962-941b-4f28-b5ab-a0a9c2bcd387 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.781445 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e80d4962-941b-4f28-b5ab-a0a9c2bcd387 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.973008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d876eccb-55b4-4031-9980-e887ec23539f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:38.981249 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d876eccb-55b4-4031-9980-e887ec23539f tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.229277 Jun 24 08:45:38.982163 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 317/633] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:38 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:38.986751 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:38.987356 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:38.989672 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e80d4962-941b-4f28-b5ab-a0a9c2bcd387 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:38.993526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.994005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.994780 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.995211 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:39.001467 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e80d4962-941b-4f28-b5ab-a0a9c2bcd387 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.233940 Jun 24 08:45:39.002070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 317/634] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:38 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:39.191605 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:39.200562 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:39.203017 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:39.204308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-94380088-678c-438a-9404-0a2b5b58e90d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.221333 Jun 24 08:45:39.204960 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 318/635] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:38 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:39.539342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-40753258-0297-4fa8-bc4b-51b202e1a9ac req-5afbfbfb-9241-4cd0-8b71-bef101bc528e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d400a3a2-9cc2-4ce5-959c-e45d459b58a9", "name": "network-vif-plugged", "status": "completed", "tag": "c281cf91-0715-4eb4-ba74-fb499c317db3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:39.550805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-40753258-0297-4fa8-bc4b-51b202e1a9ac req-5afbfbfb-9241-4cd0-8b71-bef101bc528e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:39.551349 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-40753258-0297-4fa8-bc4b-51b202e1a9ac req-5afbfbfb-9241-4cd0-8b71-bef101bc528e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:39.573016 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-40753258-0297-4fa8-bc4b-51b202e1a9ac req-5afbfbfb-9241-4cd0-8b71-bef101bc528e service nova] Creating event network-vif-plugged:c281cf91-0715-4eb4-ba74-fb499c317db3 for instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 on hv-cinder-84713 Jun 24 08:45:39.580018 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-40753258-0297-4fa8-bc4b-51b202e1a9ac req-5afbfbfb-9241-4cd0-8b71-bef101bc528e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044540 Jun 24 08:45:39.581054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 318/636] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:40.001089 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-291fa260-7388-41e3-ab38-e9ae10249ff8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:40.001722 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-291fa260-7388-41e3-ab38-e9ae10249ff8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:40.008240 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-291fa260-7388-41e3-ab38-e9ae10249ff8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.008692 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-291fa260-7388-41e3-ab38-e9ae10249ff8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.009466 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-291fa260-7388-41e3-ab38-e9ae10249ff8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.009941 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-291fa260-7388-41e3-ab38-e9ae10249ff8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.020913 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3011a475-f120-4e4d-831f-06bdd98f2345 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:40.021795 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3011a475-f120-4e4d-831f-06bdd98f2345 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:40.028803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3011a475-f120-4e4d-831f-06bdd98f2345 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.029408 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3011a475-f120-4e4d-831f-06bdd98f2345 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.031221 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3011a475-f120-4e4d-831f-06bdd98f2345 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.031757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3011a475-f120-4e4d-831f-06bdd98f2345 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.308575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-291fa260-7388-41e3-ab38-e9ae10249ff8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.316830 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-291fa260-7388-41e3-ab38-e9ae10249ff8 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.320080 Jun 24 08:45:40.317407 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 319/637] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:39 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:40.322085 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:40.322907 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:40.329679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.330156 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.330937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.331362 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.369276 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3011a475-f120-4e4d-831f-06bdd98f2345 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.382083 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3011a475-f120-4e4d-831f-06bdd98f2345 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.366397 Jun 24 08:45:40.383295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 319/638] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:40 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:40.520370 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.529793 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.531797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.533012 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-496670a9-d60d-4952-b15e-1f6dacc57e06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1721 microversion: 2.20 time: 0.214478 Jun 24 08:45:40.533604 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 320/639] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:40 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:40.937873 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-54f9a83f-0920-4614-97af-0d441e2e2969 req-28732f3a-0f6a-401e-8258-c67308842cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6c82-2da5-46c9-8757-4fa70bfa79b1", "name": "network-vif-deleted", "tag": "24b20858-8a37-47d6-98c3-e6bff8bd12c1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:40.947818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-54f9a83f-0920-4614-97af-0d441e2e2969 req-28732f3a-0f6a-401e-8258-c67308842cee service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.948174 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-54f9a83f-0920-4614-97af-0d441e2e2969 req-28732f3a-0f6a-401e-8258-c67308842cee service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.961162 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-54f9a83f-0920-4614-97af-0d441e2e2969 req-28732f3a-0f6a-401e-8258-c67308842cee service nova] Creating event network-vif-deleted:24b20858-8a37-47d6-98c3-e6bff8bd12c1 for instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 on hv-cinder-84713 Jun 24 08:45:40.966446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-54f9a83f-0920-4614-97af-0d441e2e2969 req-28732f3a-0f6a-401e-8258-c67308842cee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033524 Jun 24 08:45:40.967678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 320/640] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:41.334002 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-304a9ea1-8a53-4b0b-b70b-d156951194cb tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:41.334634 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-304a9ea1-8a53-4b0b-b70b-d156951194cb tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:41.341209 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-304a9ea1-8a53-4b0b-b70b-d156951194cb tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.341649 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-304a9ea1-8a53-4b0b-b70b-d156951194cb tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.342576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-304a9ea1-8a53-4b0b-b70b-d156951194cb tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.343162 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-304a9ea1-8a53-4b0b-b70b-d156951194cb tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.401544 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fb2f1c36-d62c-4374-b9dd-f54c6552be73 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:41.403102 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fb2f1c36-d62c-4374-b9dd-f54c6552be73 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:41.409958 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb2f1c36-d62c-4374-b9dd-f54c6552be73 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.410711 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb2f1c36-d62c-4374-b9dd-f54c6552be73 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.411506 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb2f1c36-d62c-4374-b9dd-f54c6552be73 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.411978 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb2f1c36-d62c-4374-b9dd-f54c6552be73 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.550751 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-304a9ea1-8a53-4b0b-b70b-d156951194cb tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:41.569558 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-304a9ea1-8a53-4b0b-b70b-d156951194cb tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1362 microversion: 2.1 time: 0.232309 Jun 24 08:45:41.573877 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 321/641] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:41 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:41.721119 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fb2f1c36-d62c-4374-b9dd-f54c6552be73 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:41.725407 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:41.734617 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fb2f1c36-d62c-4374-b9dd-f54c6552be73 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.336314 Jun 24 08:45:41.735695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 321/642] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:41 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:41.763711 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:41.765053 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:41.771983 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.772403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.773419 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.774053 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.808352 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.808799 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.809252 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lazy-loading 'fault' on Instance uuid 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:41.854670 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:41.866981 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:41.869642 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:41.871106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4e788af0-584a-431f-bd83-afae1ab8e835 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 200 len: 1371 microversion: 2.20 time: 0.295412 Jun 24 08:45:41.871681 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 322/643] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:41 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:41.877659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8279bcb0-8cfa-4850-bdb6-7045af99b1be tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:41.878192 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8279bcb0-8cfa-4850-bdb6-7045af99b1be tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:41.885314 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8279bcb0-8cfa-4850-bdb6-7045af99b1be tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.885793 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8279bcb0-8cfa-4850-bdb6-7045af99b1be tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.886569 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8279bcb0-8cfa-4850-bdb6-7045af99b1be tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.887005 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8279bcb0-8cfa-4850-bdb6-7045af99b1be tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.040267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-8279bcb0-8cfa-4850-bdb6-7045af99b1be tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lazy-loading 'services' on Instance uuid 7a824c83-e930-4697-a539-9888e8be39a4 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:42.184513 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8279bcb0-8cfa-4850-bdb6-7045af99b1be tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4/os-volume_attachments/71933eef-e855-432e-99b6-d188cbf7503c" status: 202 len: 0 microversion: 2.1 time: 0.312749 Jun 24 08:45:42.200375 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 322/644] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:45:41 2022] DELETE /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4/os-volume_attachments/71933eef-e855-432e-99b6-d188cbf7503c => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:45:42.590109 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a395c38e-e7f1-4a33-94d4-6eda84c1604a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:42.590644 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a395c38e-e7f1-4a33-94d4-6eda84c1604a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:42.597382 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a395c38e-e7f1-4a33-94d4-6eda84c1604a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.597876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a395c38e-e7f1-4a33-94d4-6eda84c1604a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.598646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a395c38e-e7f1-4a33-94d4-6eda84c1604a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.599091 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a395c38e-e7f1-4a33-94d4-6eda84c1604a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.736082 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a395c38e-e7f1-4a33-94d4-6eda84c1604a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:42.743612 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a395c38e-e7f1-4a33-94d4-6eda84c1604a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1548 microversion: 2.1 time: 0.157564 Jun 24 08:45:42.744180 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 323/645] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:42 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:42.754160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c20bfcf6-ea4e-4262-a049-278c101d2f0e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:42.755455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c20bfcf6-ea4e-4262-a049-278c101d2f0e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:42.761876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cea2fa0b-32cf-4380-afd5-5ac27531d1aa tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:42.762045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c20bfcf6-ea4e-4262-a049-278c101d2f0e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.762394 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c20bfcf6-ea4e-4262-a049-278c101d2f0e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.763000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cea2fa0b-32cf-4380-afd5-5ac27531d1aa tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:42.763552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c20bfcf6-ea4e-4262-a049-278c101d2f0e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.764829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c20bfcf6-ea4e-4262-a049-278c101d2f0e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.770483 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cea2fa0b-32cf-4380-afd5-5ac27531d1aa tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.770935 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cea2fa0b-32cf-4380-afd5-5ac27531d1aa tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.771703 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cea2fa0b-32cf-4380-afd5-5ac27531d1aa tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.772137 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cea2fa0b-32cf-4380-afd5-5ac27531d1aa tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:43.131465 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cea2fa0b-32cf-4380-afd5-5ac27531d1aa tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.374076 Jun 24 08:45:43.141778 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 324/646] 10.222.0.13 () {58 vars in 1274 bytes} [Fri Jun 24 08:45:42 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-interface => generated 284 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:43.148769 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:43.149800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:43.158256 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:43.158699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:43.159472 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:43.159902 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:43.175723 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] HTTP exception thrown: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Request method failure captured: Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 HTTP/1.1 Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiJ1yxU6gwMcKvuQyuNGHDcQBaUMe_tWbJCx2e_xLMqLKeRGQYDLeDjg-_iwkGgC5eirjUddisj3Txq6mTmYjN6skyyIgw3diO3Ec4SBv3bH6ZK095aaq16cgb3U_096OvJRTiB6sficN1Ghu7S4lvIsBewgfCMuYrzmRrapBx92YI Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:45:43.177396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4de333e57ed34492bee6491335ff4356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4de333e57ed34492bee6491335ff4356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 75a612089b2b46a6b3ff5a6cd9e59579 Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:45:43.178948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '2ebf6c82-2da5-46c9-8757-4fa70bfa79b1'} Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:45:43.179847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:45:43.181800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:43.184489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Returning 404 to user: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:45:43.184489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-96b79442-8b52-4373-9255-38bec6ff0ae8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 404 len: 111 microversion: 2.20 time: 0.035894 Jun 24 08:45:43.184489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 325/647] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:43 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:45:43.188162 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3762f8c4-5b4b-4d53-acb9-e8ba8eaeeca6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '.version_select at 0x7f0a6ff1de50>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:43.190336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c20bfcf6-ea4e-4262-a049-278c101d2f0e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:43.200842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c20bfcf6-ea4e-4262-a049-278c101d2f0e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.452234 Jun 24 08:45:43.209783 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 323/648] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:42 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:43.221445 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3762f8c4-5b4b-4d53-acb9-e8ba8eaeeca6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850522714" status: 204 len: 0 microversion: 2.20 time: 0.036890 Jun 24 08:45:43.223106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 326/649] 10.222.0.13 () {60 vars in 1261 bytes} [Fri Jun 24 08:45:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850522714 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:45:43.928811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b5b87911-04fb-4ccc-9c2e-c5370e502c02 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'create', calling method: .version_select at 0x7f0a7c76da60>, body: {"keypair": {"name": "tempest-keypair-954309447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZ5C1It7DDNlgBWfi9iulwf5UxA/TKN9DYjtc+k6vVJtB6AogkhigidvZs5PhBp01VNmuIRgSoI3SJc1dRn7SaDbBN73r7hx+9/1BhKPFXeFnfOgmmhpJ15m+dLSQ3XBQ=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:43.943915 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-b5b87911-04fb-4ccc-9c2e-c5370e502c02 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Getting quotas for project 4de333e57ed34492bee6491335ff4356. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:45:43.947828 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-b5b87911-04fb-4ccc-9c2e-c5370e502c02 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Getting quotas for user 75a612089b2b46a6b3ff5a6cd9e59579 and project 4de333e57ed34492bee6491335ff4356. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:45:43.972747 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b5b87911-04fb-4ccc-9c2e-c5370e502c02 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047842 Jun 24 08:45:43.973354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 324/650] 10.222.0.13 () {62 vars in 1199 bytes} [Fri Jun 24 08:45:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 08:45:44.197007 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-d8bb23e6-d337-4d7f-9e7c-460cb3ea9bf7 req-d9365a76-5536-4219-a1f2-403959392f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d400a3a2-9cc2-4ce5-959c-e45d459b58a9", "tag": "c281cf91-0715-4eb4-ba74-fb499c317db3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:44.207698 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-d8bb23e6-d337-4d7f-9e7c-460cb3ea9bf7 req-d9365a76-5536-4219-a1f2-403959392f31 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:44.208640 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-d8bb23e6-d337-4d7f-9e7c-460cb3ea9bf7 req-d9365a76-5536-4219-a1f2-403959392f31 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:44.220642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-faea0008-816a-4745-b207-1d19eecd130f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:44.221258 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-faea0008-816a-4745-b207-1d19eecd130f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:44.230906 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-faea0008-816a-4745-b207-1d19eecd130f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:44.234564 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-faea0008-816a-4745-b207-1d19eecd130f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:44.235788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-faea0008-816a-4745-b207-1d19eecd130f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:44.236444 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-faea0008-816a-4745-b207-1d19eecd130f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:44.241565 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-d8bb23e6-d337-4d7f-9e7c-460cb3ea9bf7 req-d9365a76-5536-4219-a1f2-403959392f31 service nova] Creating event network-changed:c281cf91-0715-4eb4-ba74-fb499c317db3 for instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 on hv-cinder-84713 Jun 24 08:45:44.251138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-d8bb23e6-d337-4d7f-9e7c-460cb3ea9bf7 req-d9365a76-5536-4219-a1f2-403959392f31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058501 Jun 24 08:45:44.252307 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 327/651] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:44.430237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-faea0008-816a-4745-b207-1d19eecd130f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:44.440724 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-faea0008-816a-4745-b207-1d19eecd130f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.224780 Jun 24 08:45:44.441876 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 325/652] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:44 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:45.463153 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d1bb72d8-fd26-4efc-beb0-9e441821cbc5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:45.463887 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d1bb72d8-fd26-4efc-beb0-9e441821cbc5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:45.471513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d1bb72d8-fd26-4efc-beb0-9e441821cbc5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.471980 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d1bb72d8-fd26-4efc-beb0-9e441821cbc5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.472680 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3ebcb275-7a1e-463d-bef8-728711904bb5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:45.473156 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d1bb72d8-fd26-4efc-beb0-9e441821cbc5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.473156 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d1bb72d8-fd26-4efc-beb0-9e441821cbc5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.474020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3ebcb275-7a1e-463d-bef8-728711904bb5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:45.481582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ebcb275-7a1e-463d-bef8-728711904bb5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.483609 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ebcb275-7a1e-463d-bef8-728711904bb5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.485400 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ebcb275-7a1e-463d-bef8-728711904bb5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.486131 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ebcb275-7a1e-463d-bef8-728711904bb5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.521582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3ebcb275-7a1e-463d-bef8-728711904bb5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:45:45.613808 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3ebcb275-7a1e-463d-bef8-728711904bb5 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 204 len: 0 microversion: 2.1 time: 0.147113 Jun 24 08:45:45.617953 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 326/653] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:45:45 2022] DELETE /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:45:45.620825 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1080138550", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6cb1f6d-0926-47d2-a6bc-b702c79729da"}], "security_groups": [{"name": "tempest-securitygroup--1462395523"}], "key_name": "tempest-keypair-954309447", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:45.664014 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d1bb72d8-fd26-4efc-beb0-9e441821cbc5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:45.674391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d1bb72d8-fd26-4efc-beb0-9e441821cbc5 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.219466 Jun 24 08:45:45.675070 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 328/654] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:45 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:45.679901 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a730abb2-caf7-43b3-90fb-7f2cc370f756 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:45.680615 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a730abb2-caf7-43b3-90fb-7f2cc370f756 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:45.688290 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a730abb2-caf7-43b3-90fb-7f2cc370f756 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.688741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a730abb2-caf7-43b3-90fb-7f2cc370f756 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.689520 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a730abb2-caf7-43b3-90fb-7f2cc370f756 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.690000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a730abb2-caf7-43b3-90fb-7f2cc370f756 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.740681 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] validate_networks() for [('d6cb1f6d-0926-47d2-a6bc-b702c79729da', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:45:45.915647 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a730abb2-caf7-43b3-90fb-7f2cc370f756 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:45.924069 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a730abb2-caf7-43b3-90fb-7f2cc370f756 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1515 microversion: 2.1 time: 0.247986 Jun 24 08:45:45.924743 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 329/655] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:45 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:46.196060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:45:46.196485 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:45:46.196979 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:45:46.197389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:45:46.197901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:45:46.207499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.207976 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.208788 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.209229 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.226263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Getting quotas for project 4de333e57ed34492bee6491335ff4356. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:45:46.230218 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Getting quotas for user 75a612089b2b46a6b3ff5a6cd9e59579 and project 4de333e57ed34492bee6491335ff4356. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:45:46.232549 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:46.243993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:45:46.246404 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:45:46.297705 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-89af7b2c-b62a-47b7-b8b3-8b7f4681f0ca tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.681622 Jun 24 08:45:46.298401 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 327/656] 10.222.0.13 () {62 vars in 1187 bytes} [Fri Jun 24 08:45:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 08:45:46.308586 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4ffacd79-238e-4aeb-b93d-1b58d9464e47 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:46.309308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4ffacd79-238e-4aeb-b93d-1b58d9464e47 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:46.379819 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4ffacd79-238e-4aeb-b93d-1b58d9464e47 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.394335 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4ffacd79-238e-4aeb-b93d-1b58d9464e47 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.397084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4ffacd79-238e-4aeb-b93d-1b58d9464e47 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.398736 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4ffacd79-238e-4aeb-b93d-1b58d9464e47 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1281 microversion: 2.20 time: 0.094199 Jun 24 08:45:46.399452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 330/657] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:46 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:46.692596 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-92d2f3d3-4faf-4064-bfc1-c4a0ac601806 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:46.693210 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-92d2f3d3-4faf-4064-bfc1-c4a0ac601806 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:46.700029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92d2f3d3-4faf-4064-bfc1-c4a0ac601806 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.700484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92d2f3d3-4faf-4064-bfc1-c4a0ac601806 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.701862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92d2f3d3-4faf-4064-bfc1-c4a0ac601806 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.702518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92d2f3d3-4faf-4064-bfc1-c4a0ac601806 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.840387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92d2f3d3-4faf-4064-bfc1-c4a0ac601806 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.850467 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-92d2f3d3-4faf-4064-bfc1-c4a0ac601806 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1733 microversion: 2.1 time: 0.162156 Jun 24 08:45:46.851090 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 328/658] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:46 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:46.943221 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f8066638-6607-4ec0-9fbe-40ae59c3ab13 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:46.943971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f8066638-6607-4ec0-9fbe-40ae59c3ab13 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:46.946514 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:46.955357 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8066638-6607-4ec0-9fbe-40ae59c3ab13 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.955805 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8066638-6607-4ec0-9fbe-40ae59c3ab13 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.956579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8066638-6607-4ec0-9fbe-40ae59c3ab13 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.957017 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8066638-6607-4ec0-9fbe-40ae59c3ab13 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.984268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:47.116048 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f8066638-6607-4ec0-9fbe-40ae59c3ab13 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:47.124344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f8066638-6607-4ec0-9fbe-40ae59c3ab13 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1515 microversion: 2.1 time: 0.186751 Jun 24 08:45:47.125169 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 331/659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:46 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:47.419132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:47.419862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:47.427256 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.428146 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:47.428553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.429008 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:47.502657 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:47.509715 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:47.511250 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:47.512358 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bdbdaf12-8d8d-416d-a8b7-812483a9f7e3 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1285 microversion: 2.20 time: 0.097601 Jun 24 08:45:47.512919 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 329/660] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:47 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:47.869582 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-328cc2a4-d726-475d-934e-759c3ef4b246 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:47.870794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-328cc2a4-d726-475d-934e-759c3ef4b246 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:47.881272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-328cc2a4-d726-475d-934e-759c3ef4b246 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.881795 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-328cc2a4-d726-475d-934e-759c3ef4b246 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:47.882832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-328cc2a4-d726-475d-934e-759c3ef4b246 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.883272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-328cc2a4-d726-475d-934e-759c3ef4b246 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.150022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8c68c695-69f5-4536-bbae-bb364dbb4498 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:48.151139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8c68c695-69f5-4536-bbae-bb364dbb4498 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:48.162724 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c68c695-69f5-4536-bbae-bb364dbb4498 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.163296 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c68c695-69f5-4536-bbae-bb364dbb4498 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.164344 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c68c695-69f5-4536-bbae-bb364dbb4498 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.165013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c68c695-69f5-4536-bbae-bb364dbb4498 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.207544 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-328cc2a4-d726-475d-934e-759c3ef4b246 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.229136 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-328cc2a4-d726-475d-934e-759c3ef4b246 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1713 microversion: 2.1 time: 0.365268 Jun 24 08:45:48.240410 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 332/661] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:47 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1713 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:48.386444 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:48.387086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:48.395813 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.396122 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.397000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.397779 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.490292 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8c68c695-69f5-4536-bbae-bb364dbb4498 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.504197 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] HTTP exception thrown: Cannot 'detach_volume' instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 while it is in vm_state rescued Jun 24 08:45:48.505789 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8c68c695-69f5-4536-bbae-bb364dbb4498 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1515 microversion: 2.1 time: 0.362397 Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Request method failure captured: Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments/5b70e56b-d312-4042-8d02-69634e39295c HTTP/1.1 Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiVits7z_fNY9CIdaVGFwsyyojS1gN_005o09PgebDbafPXTjFtE0sMjdOvU7dXDThXGKu3RBAjPIRw6jmKgz9siH16jgnXL3L5kANDajWkrvFKUibt6kjc2oMQPduH420ivpFFX0X8yRrwy2kU5dysnMtxSK-KhekZ8UMKvyDfK_k Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:45:48.505926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dfa535df5dd14d69bb3ca125cbd9fe13", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 71e0fd73e5c9430c813af1de9ccd4a52 Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:45:48.507255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Cannot 'detach_volume' instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 while it is in vm_state rescued Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'server_id': '7c7b568a-ef02-4854-a5e2-96aa05ba02a9', 'id': '5b70e56b-d312-4042-8d02-69634e39295c'} Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:45:48.507962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 while it is in vm_state rescued Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 while it is in vm_state rescued Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:48.509631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Returning 409 to user: Cannot 'detach_volume' instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 while it is in vm_state rescued {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:45:48.511838 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 330/662] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:48 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:48.516212 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b8ea245a-21be-48fb-a4bc-6b55a124e9ab tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments/5b70e56b-d312-4042-8d02-69634e39295c" status: 409 len: 152 microversion: 2.1 time: 0.126530 Jun 24 08:45:48.517642 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 333/663] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:45:48 2022] DELETE /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments/5b70e56b-d312-4042-8d02-69634e39295c => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:45:48.534957 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6bedbf3f-a6ec-4b89-88a5-708158c9a9de tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:48.535600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6bedbf3f-a6ec-4b89-88a5-708158c9a9de tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:48.539004 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:48.539616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:48.543342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bedbf3f-a6ec-4b89-88a5-708158c9a9de tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.543894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bedbf3f-a6ec-4b89-88a5-708158c9a9de tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.544684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bedbf3f-a6ec-4b89-88a5-708158c9a9de tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.545249 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bedbf3f-a6ec-4b89-88a5-708158c9a9de tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.553016 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.553464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.554489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.554925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.644743 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.655124 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.657917 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6bedbf3f-a6ec-4b89-88a5-708158c9a9de tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "POST /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/action" status: 202 len: 0 microversion: 2.1 time: 0.128428 Jun 24 08:45:48.658781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 331/664] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:45:48 2022] POST /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:45:48.668650 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e99a0a83-cde8-4760-a36a-63befc0da4a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:48.669543 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.669774 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e99a0a83-cde8-4760-a36a-63befc0da4a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:48.676198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e1b28a68-3b54-4875-840f-17448d20034a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1333 microversion: 2.20 time: 0.141032 Jun 24 08:45:48.678050 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 334/665] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:48 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1333 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:48.680647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e99a0a83-cde8-4760-a36a-63befc0da4a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.681588 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e99a0a83-cde8-4760-a36a-63befc0da4a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.682473 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e99a0a83-cde8-4760-a36a-63befc0da4a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.683055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e99a0a83-cde8-4760-a36a-63befc0da4a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.072692 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e99a0a83-cde8-4760-a36a-63befc0da4a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.082349 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e99a0a83-cde8-4760-a36a-63befc0da4a9 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1721 microversion: 2.1 time: 0.418393 Jun 24 08:45:49.083177 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 332/666] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:48 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1721 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:49.103398 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-691583ab-174b-4a58-977f-547240a30128 req-bd550104-4764-4a2c-b239-9498314ba5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a824c83-e930-4697-a539-9888e8be39a4", "name": "network-vif-deleted", "tag": "ac5a6d4f-5b28-4778-959c-d049871f46e5"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:49.113810 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-691583ab-174b-4a58-977f-547240a30128 req-bd550104-4764-4a2c-b239-9498314ba5cc service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.114587 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-691583ab-174b-4a58-977f-547240a30128 req-bd550104-4764-4a2c-b239-9498314ba5cc service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.144619 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-691583ab-174b-4a58-977f-547240a30128 req-bd550104-4764-4a2c-b239-9498314ba5cc service nova] Creating event network-vif-deleted:ac5a6d4f-5b28-4778-959c-d049871f46e5 for instance 7a824c83-e930-4697-a539-9888e8be39a4 on hv-cinder-84713 Jun 24 08:45:49.157457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-691583ab-174b-4a58-977f-547240a30128 req-bd550104-4764-4a2c-b239-9498314ba5cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059852 Jun 24 08:45:49.162780 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 335/667] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:49.524900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:49.525911 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:49.542762 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.543198 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.545136 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.545757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.613521 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.614546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.615898 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lazy-loading 'fault' on Instance uuid 7a824c83-e930-4697-a539-9888e8be39a4 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:49.703617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:49.704831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:49.722737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.723967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.725438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.726555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.735346 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039bddb840c4ac784f0b1c52326c79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c244fc43f94ea2bc9f76965c111e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.743917 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-139d0227-d18f-4561-9317-6d36c44eaec7 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 200 len: 1309 microversion: 2.1 time: 0.223043 Jun 24 08:45:49.744889 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 333/668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:49 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 1309 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:49.852833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.863018 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.864509 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.865617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-334ff073-b397-4ddf-8b62-1b471806d4ff tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1339 microversion: 2.20 time: 0.169510 Jun 24 08:45:49.866216 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 336/669] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:49 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:50.102842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9cd6f741-e9e8-4842-beda-7907604edee0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:50.103499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9cd6f741-e9e8-4842-beda-7907604edee0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:50.111259 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cd6f741-e9e8-4842-beda-7907604edee0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.111698 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cd6f741-e9e8-4842-beda-7907604edee0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.112462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cd6f741-e9e8-4842-beda-7907604edee0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.112894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cd6f741-e9e8-4842-beda-7907604edee0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.274211 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9cd6f741-e9e8-4842-beda-7907604edee0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:50.283332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9cd6f741-e9e8-4842-beda-7907604edee0 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1721 microversion: 2.1 time: 0.184388 Jun 24 08:45:50.283900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 334/670] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:50 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:50.764274 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:50.765377 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] [instance: 7a824c83-e930-4697-a539-9888e8be39a4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:50.772361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.772803 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.773565 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.774031 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.788858 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] HTTP exception thrown: Instance 7a824c83-e930-4697-a539-9888e8be39a4 could not be found. Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Request method failure captured: Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 HTTP/1.1 Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXk7L1V6FNjfD6Gwl0n6pLp_esdpPwuPw7rpWcRDvGYFX6fjScUa1u9YbphrQCFLGYnSg8XVg2Ap9aokJZaSnQkZgyjcMGvkbEzBrQ02RZUOvbkMZxjFLSZQKNZCwV0FH3wztvc1QsMQqapWDoqSBPFBBNlb-eeJR7A6_VQ-nfiXTSQ Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 84c244fc43f94ea2bc9f76965c111e78 Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotTestJSON-10493388 Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:45:50.790546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/84c244fc43f94ea2bc9f76965c111e78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/84c244fc43f94ea2bc9f76965c111e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/84c244fc43f94ea2bc9f76965c111e78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_84c244fc43f94ea2bc9f76965c111e78", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotTestJSON-10493388 Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 84c244fc43f94ea2bc9f76965c111e78 Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-10493388 Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotTestJSON-10493388-project Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 2039bddb840c4ac784f0b1c52326c79f Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotTestJSON-10493388-project Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 7a824c83-e930-4697-a539-9888e8be39a4 could not be found. Jun 24 08:45:50.792060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '7a824c83-e930-4697-a539-9888e8be39a4'} Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a824c83-e930-4697-a539-9888e8be39a4 could not be found. Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:45:50.792842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a824c83-e930-4697-a539-9888e8be39a4 could not be found. Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a824c83-e930-4697-a539-9888e8be39a4 could not be found. Jun 24 08:45:50.794301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:45:50.795577 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] Returning 404 to user: Instance 7a824c83-e930-4697-a539-9888e8be39a4 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:45:50.795577 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-900fc986-672b-4a93-a06d-55021fe02144 tempest-VolumesSnapshotTestJSON-10493388 tempest-VolumesSnapshotTestJSON-10493388-project] 10.222.0.13 "GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4" status: 404 len: 111 microversion: 2.1 time: 0.032350 Jun 24 08:45:50.795577 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 337/671] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:50 2022] GET /compute/v2.1/servers/7a824c83-e930-4697-a539-9888e8be39a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:45:50.885624 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:50.886346 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:50.894775 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.895224 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.896001 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.896438 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.103288 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.120848 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.122419 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.124104 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cb64e7d1-f7e8-49b0-8729-b7a4cf5365b9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.242567 Jun 24 08:45:51.124715 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 335/672] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:50 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:51.301280 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-47c41fbc-454c-4dc6-b6e4-9daa743fba16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:51.301837 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-47c41fbc-454c-4dc6-b6e4-9daa743fba16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:51.307920 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-47c41fbc-454c-4dc6-b6e4-9daa743fba16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.308364 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-47c41fbc-454c-4dc6-b6e4-9daa743fba16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.309162 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-47c41fbc-454c-4dc6-b6e4-9daa743fba16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.309600 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-47c41fbc-454c-4dc6-b6e4-9daa743fba16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.537477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-47c41fbc-454c-4dc6-b6e4-9daa743fba16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.547080 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-47c41fbc-454c-4dc6-b6e4-9daa743fba16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1721 microversion: 2.1 time: 0.249670 Jun 24 08:45:51.547661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 338/673] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:51 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:51.823387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-567d4cac-a7a9-426b-ae73-9cb027299de4 req-af5b92e5-1f15-4265-a8c4-1d16d399061c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268", "tag": "43c59752-b640-4bc3-91df-788def083aa2"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:51.832728 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-567d4cac-a7a9-426b-ae73-9cb027299de4 req-af5b92e5-1f15-4265-a8c4-1d16d399061c service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.833816 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-567d4cac-a7a9-426b-ae73-9cb027299de4 req-af5b92e5-1f15-4265-a8c4-1d16d399061c service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.846166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-567d4cac-a7a9-426b-ae73-9cb027299de4 req-af5b92e5-1f15-4265-a8c4-1d16d399061c service nova] Creating event network-changed:43c59752-b640-4bc3-91df-788def083aa2 for instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 on hv-cinder-84713 Jun 24 08:45:51.851297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-567d4cac-a7a9-426b-ae73-9cb027299de4 req-af5b92e5-1f15-4265-a8c4-1d16d399061c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031692 Jun 24 08:45:51.852000 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 336/674] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:52.142304 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:52.143731 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:52.151178 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.151893 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.153045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.153706 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.377112 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:52.385000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:52.386532 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:52.387971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-37e467ca-00a4-4457-bd6c-57dd3f448c70 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.250577 Jun 24 08:45:52.388531 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 339/675] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:52 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:52.565461 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d5d321d6-c76d-4df6-adda-3570bc536d31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:52.566255 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d5d321d6-c76d-4df6-adda-3570bc536d31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:52.573380 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5d321d6-c76d-4df6-adda-3570bc536d31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.573889 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5d321d6-c76d-4df6-adda-3570bc536d31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.574657 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5d321d6-c76d-4df6-adda-3570bc536d31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.575089 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5d321d6-c76d-4df6-adda-3570bc536d31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.580407 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:52.956704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d5d321d6-c76d-4df6-adda-3570bc536d31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:52.964529 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d5d321d6-c76d-4df6-adda-3570bc536d31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1727 microversion: 2.1 time: 0.404886 Jun 24 08:45:52.965093 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 337/676] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:52 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1727 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:52.980775 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9da4eb33-c510-4748-b036-d7b23f6de592 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:52.981268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9da4eb33-c510-4748-b036-d7b23f6de592 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:52.987905 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9da4eb33-c510-4748-b036-d7b23f6de592 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.988348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9da4eb33-c510-4748-b036-d7b23f6de592 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.989102 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9da4eb33-c510-4748-b036-d7b23f6de592 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.989576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9da4eb33-c510-4748-b036-d7b23f6de592 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:53.071496 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9da4eb33-c510-4748-b036-d7b23f6de592 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094522 Jun 24 08:45:53.072096 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 340/677] 10.222.0.13 () {58 vars in 1274 bytes} [Fri Jun 24 08:45:52 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:53.407751 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:53.408361 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:53.414359 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:53.414807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:53.415576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:53.416012 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:53.565167 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:53.578739 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:53.580736 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:53.582161 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0425132c-b329-4bd2-aaf5-0667e7f1ab34 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.179600 Jun 24 08:45:53.582886 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 338/678] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:53 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:54.206887 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-5743f7f4-f37e-47c9-bd2e-69f9a9c67585 req-8e04a01a-3419-404d-81a0-ad0db922afbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7b568a-ef02-4854-a5e2-96aa05ba02a9", "tag": "3d39ea3a-6eab-4732-b461-bbfa249534b3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:54.218168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-5743f7f4-f37e-47c9-bd2e-69f9a9c67585 req-8e04a01a-3419-404d-81a0-ad0db922afbd service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.218771 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-5743f7f4-f37e-47c9-bd2e-69f9a9c67585 req-8e04a01a-3419-404d-81a0-ad0db922afbd service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.231571 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-5743f7f4-f37e-47c9-bd2e-69f9a9c67585 req-8e04a01a-3419-404d-81a0-ad0db922afbd service nova] Creating event network-changed:3d39ea3a-6eab-4732-b461-bbfa249534b3 for instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 on hv-cinder-84713 Jun 24 08:45:54.240545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-5743f7f4-f37e-47c9-bd2e-69f9a9c67585 req-8e04a01a-3419-404d-81a0-ad0db922afbd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037225 Jun 24 08:45:54.241624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 341/679] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:54.610621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:54.611419 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:54.618399 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.618832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.619590 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.620024 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.754730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:54.762597 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:54.764097 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:54.765205 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e796a0c0-7ef2-4624-8a94-faea81ed8090 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.161914 Jun 24 08:45:54.765785 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 339/680] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:54 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:55.785796 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:55.786825 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:55.794509 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:55.795511 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:55.796299 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:55.796887 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:55.933254 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:55.942081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:55.943575 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:55.944678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7c0d52cd-0ffa-450e-b111-4935055f7ec1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.164815 Jun 24 08:45:55.945234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 342/681] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:55 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:56.254883 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-276be0f9-b701-45cf-a840-9fa58eccfb6e req-d81744fe-36a6-4849-ac20-e9835d0102e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7b568a-ef02-4854-a5e2-96aa05ba02a9", "tag": "3d39ea3a-6eab-4732-b461-bbfa249534b3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:56.258882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:56.259535 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=10 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:56.266892 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-276be0f9-b701-45cf-a840-9fa58eccfb6e req-d81744fe-36a6-4849-ac20-e9835d0102e6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:56.267327 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-276be0f9-b701-45cf-a840-9fa58eccfb6e req-d81744fe-36a6-4849-ac20-e9835d0102e6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:56.282193 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-276be0f9-b701-45cf-a840-9fa58eccfb6e req-d81744fe-36a6-4849-ac20-e9835d0102e6 service nova] Creating event network-changed:3d39ea3a-6eab-4732-b461-bbfa249534b3 for instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 on hv-cinder-84713 Jun 24 08:45:56.286746 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-276be0f9-b701-45cf-a840-9fa58eccfb6e req-d81744fe-36a6-4849-ac20-e9835d0102e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035601 Jun 24 08:45:56.287338 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 340/682] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:56.963460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:56.964099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:56.968178 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:56.972753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:56.973190 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:56.973997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:56.974614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:57.128536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:57.136657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:57.138253 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:57.140765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e9dc5589-7cd7-4cfe-bc23-d7bf962e2be6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.181834 Jun 24 08:45:57.141345 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 343/683] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:56 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:58.160400 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:58.161098 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:58.168461 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:58.169077 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:58.170491 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:58.171413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:58.328318 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:58.336602 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:58.338116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:58.339215 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ef440a68-75b4-4fc5-9efb-eb319c7656a7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.183792 Jun 24 08:45:58.339778 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 341/684] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:58 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:59.358507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:59.359111 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:59.365746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.366197 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:59.366956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.367391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:59.534046 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:59.542486 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:59.544143 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:59.546224 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b03567ec-f4a0-4af0-8296-f37e2d07b12d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.191866 Jun 24 08:45:59.546788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 344/685] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:59 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:59.675011 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-50d9bb6a-5524-443a-b424-f0ef0d50248a req-c9de0488-47e1-4f4a-a061-cf0867cb86e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268", "name": "network-vif-plugged", "status": "completed", "tag": "43c59752-b640-4bc3-91df-788def083aa2"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:59.683043 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-50d9bb6a-5524-443a-b424-f0ef0d50248a req-c9de0488-47e1-4f4a-a061-cf0867cb86e7 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.683493 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-50d9bb6a-5524-443a-b424-f0ef0d50248a req-c9de0488-47e1-4f4a-a061-cf0867cb86e7 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:59.697928 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-50d9bb6a-5524-443a-b424-f0ef0d50248a req-c9de0488-47e1-4f4a-a061-cf0867cb86e7 service nova] Creating event network-vif-plugged:43c59752-b640-4bc3-91df-788def083aa2 for instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 on hv-cinder-84713 Jun 24 08:45:59.704858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-50d9bb6a-5524-443a-b424-f0ef0d50248a req-c9de0488-47e1-4f4a-a061-cf0867cb86e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034764 Jun 24 08:45:59.705520 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 342/686] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:46:00.564198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:00.564825 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:00.571464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:00.571903 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:00.572673 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:00.573102 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:00.707944 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:00.715950 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:00.718088 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:00.719231 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f887bb41-d05c-4dea-98ac-0a19036059f7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.159830 Jun 24 08:46:00.719804 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 345/687] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:00 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:01.741176 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:01.741945 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:01.748091 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:01.748516 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:01.749872 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:01.750644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:01.880426 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:01.888458 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:01.890538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:01.892022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-baeb4316-d16a-47b5-bafd-ffb1bc8c5d60 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.155571 Jun 24 08:46:01.892583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 343/688] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:01 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:02.911979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:02.912600 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:02.919656 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:02.920108 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:02.921789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:02.922305 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:03.065109 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:03.073054 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:03.074581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:03.075679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f39a409c-6de9-4012-b252-4dc152870c9f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.168554 Jun 24 08:46:03.076237 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 346/689] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:02 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:04.093757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:04.094363 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:04.101303 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:04.102009 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:04.102791 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:04.103232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:04.249603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:04.258723 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:04.260172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:04.261287 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4e3039a5-56cf-4971-8214-d8cac5228f06 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1407 microversion: 2.20 time: 0.171785 Jun 24 08:46:04.261870 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 344/690] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:04 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:05.281666 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:05.282318 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:05.290565 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:05.291040 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:05.291878 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:05.292329 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:05.450814 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:05.460514 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:05.462507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:05.463915 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-78c58ba3-2921-47be-a88f-b5f599d61b8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1597 microversion: 2.20 time: 0.187511 Jun 24 08:46:05.464585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 347/691] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:05 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1597 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:05.482464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-38458c7c-39c8-4bcf-a957-b724093fe6e6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:05.483055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-38458c7c-39c8-4bcf-a957-b724093fe6e6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:05.493534 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38458c7c-39c8-4bcf-a957-b724093fe6e6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:05.494006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38458c7c-39c8-4bcf-a957-b724093fe6e6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:05.494765 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38458c7c-39c8-4bcf-a957-b724093fe6e6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:05.495193 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38458c7c-39c8-4bcf-a957-b724093fe6e6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:05.585355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-38458c7c-39c8-4bcf-a957-b724093fe6e6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106843 Jun 24 08:46:05.585991 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 345/692] 10.222.0.13 () {60 vars in 1315 bytes} [Fri Jun 24 08:46:05 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:46:06.804455 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-8f0186b7-3ad0-4f4c-baba-920633f4e31c req-1c4b8e4a-2e5d-4419-ac76-a377acfa311f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268", "tag": "43c59752-b640-4bc3-91df-788def083aa2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:06.813774 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-8f0186b7-3ad0-4f4c-baba-920633f4e31c req-1c4b8e4a-2e5d-4419-ac76-a377acfa311f service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:06.814225 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-8f0186b7-3ad0-4f4c-baba-920633f4e31c req-1c4b8e4a-2e5d-4419-ac76-a377acfa311f service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:06.825497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-8f0186b7-3ad0-4f4c-baba-920633f4e31c req-1c4b8e4a-2e5d-4419-ac76-a377acfa311f service nova] Creating event network-changed:43c59752-b640-4bc3-91df-788def083aa2 for instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 on hv-cinder-84713 Jun 24 08:46:06.831204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-8f0186b7-3ad0-4f4c-baba-920633f4e31c req-1c4b8e4a-2e5d-4419-ac76-a377acfa311f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030350 Jun 24 08:46:06.831803 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 348/693] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:46:22.944381 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:22.945167 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=42 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:23.205650 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-75a4755f-ab15-42ea-8770-1b90ee903141 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:23.206165 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-75a4755f-ab15-42ea-8770-1b90ee903141 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:23.212374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75a4755f-ab15-42ea-8770-1b90ee903141 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:23.212805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75a4755f-ab15-42ea-8770-1b90ee903141 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:23.213564 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75a4755f-ab15-42ea-8770-1b90ee903141 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:23.214025 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75a4755f-ab15-42ea-8770-1b90ee903141 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:23.245675 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-75a4755f-ab15-42ea-8770-1b90ee903141 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/ips" status: 200 len: 146 microversion: 2.1 time: 0.303301 Jun 24 08:46:23.246281 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 346/694] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:46:22 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/ips => generated 146 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:24.621173 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=35 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:24.622011 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=86 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:24.626940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bda73a3d-b7af-45a1-b591-73265cbdd764 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af4be984-d120-4372-97f6-067447344c47"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:24.628038 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bda73a3d-b7af-45a1-b591-73265cbdd764 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:24.635234 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda73a3d-b7af-45a1-b591-73265cbdd764 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.635675 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda73a3d-b7af-45a1-b591-73265cbdd764 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.636447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda73a3d-b7af-45a1-b591-73265cbdd764 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.636879 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda73a3d-b7af-45a1-b591-73265cbdd764 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.949396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bda73a3d-b7af-45a1-b591-73265cbdd764 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329656 Jun 24 08:46:24.950464 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 349/695] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:46:24 2022] POST /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:32.019676 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e6e98baf-0e31-4552-b141-78ddb9e33e13 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:32.020214 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e6e98baf-0e31-4552-b141-78ddb9e33e13 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:32.026860 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6e98baf-0e31-4552-b141-78ddb9e33e13 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.027313 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6e98baf-0e31-4552-b141-78ddb9e33e13 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.028297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6e98baf-0e31-4552-b141-78ddb9e33e13 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.028803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6e98baf-0e31-4552-b141-78ddb9e33e13 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.109018 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-e6e98baf-0e31-4552-b141-78ddb9e33e13 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lazy-loading 'services' on Instance uuid 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:46:32.182279 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e6e98baf-0e31-4552-b141-78ddb9e33e13 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments/5b70e56b-d312-4042-8d02-69634e39295c" status: 202 len: 0 microversion: 2.1 time: 0.166281 Jun 24 08:46:32.182873 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 347/696] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:46:32 2022] DELETE /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments/5b70e56b-d312-4042-8d02-69634e39295c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:46:32.193046 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3137b2c2-bbcb-45e0-a427-bb3dac0dba31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:32.194171 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3137b2c2-bbcb-45e0-a427-bb3dac0dba31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:32.201581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3137b2c2-bbcb-45e0-a427-bb3dac0dba31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.202186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3137b2c2-bbcb-45e0-a427-bb3dac0dba31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.203212 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3137b2c2-bbcb-45e0-a427-bb3dac0dba31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.204398 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3137b2c2-bbcb-45e0-a427-bb3dac0dba31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.238681 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3137b2c2-bbcb-45e0-a427-bb3dac0dba31 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050696 Jun 24 08:46:32.239283 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 350/697] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:46:32 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:32.483693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bdaefc13-f411-43e0-81dd-4bb49983356e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:32.484844 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bdaefc13-f411-43e0-81dd-4bb49983356e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:32.491074 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdaefc13-f411-43e0-81dd-4bb49983356e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.491519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdaefc13-f411-43e0-81dd-4bb49983356e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.492298 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdaefc13-f411-43e0-81dd-4bb49983356e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.492734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdaefc13-f411-43e0-81dd-4bb49983356e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.521817 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bdaefc13-f411-43e0-81dd-4bb49983356e tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Jun 24 08:46:32.522295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 348/698] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:46:32 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:32.532972 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a02015b0-8525-4a4e-97dc-96bd77f1e412 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:32.533500 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a02015b0-8525-4a4e-97dc-96bd77f1e412 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:32.540026 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a02015b0-8525-4a4e-97dc-96bd77f1e412 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.540843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a02015b0-8525-4a4e-97dc-96bd77f1e412 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.541649 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a02015b0-8525-4a4e-97dc-96bd77f1e412 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.542111 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a02015b0-8525-4a4e-97dc-96bd77f1e412 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.572508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a02015b0-8525-4a4e-97dc-96bd77f1e412 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/af4be984-d120-4372-97f6-067447344c47" status: 200 len: 194 microversion: 2.1 time: 0.044304 Jun 24 08:46:32.573091 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 351/699] 10.222.0.13 () {58 vars in 1412 bytes} [Fri Jun 24 08:46:32 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/af4be984-d120-4372-97f6-067447344c47 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:33.251921 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7a4cf923-8581-4cbe-b9c2-e856e31d3634 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:33.252850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7a4cf923-8581-4cbe-b9c2-e856e31d3634 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:33.259712 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a4cf923-8581-4cbe-b9c2-e856e31d3634 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.260213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a4cf923-8581-4cbe-b9c2-e856e31d3634 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:33.260989 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a4cf923-8581-4cbe-b9c2-e856e31d3634 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.261487 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a4cf923-8581-4cbe-b9c2-e856e31d3634 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:33.294033 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7a4cf923-8581-4cbe-b9c2-e856e31d3634 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Jun 24 08:46:33.294634 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 349/700] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:46:33 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:33.917134 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ad14c8cd-ff25-41a0-8544-418eeef08509 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1140d3c7-99f6-4236-b804-ca5f89eda1cc"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:33.918225 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ad14c8cd-ff25-41a0-8544-418eeef08509 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:33.924762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad14c8cd-ff25-41a0-8544-418eeef08509 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.925202 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad14c8cd-ff25-41a0-8544-418eeef08509 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:33.926000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad14c8cd-ff25-41a0-8544-418eeef08509 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.926429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad14c8cd-ff25-41a0-8544-418eeef08509 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.199832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ad14c8cd-ff25-41a0-8544-418eeef08509 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "POST /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286484 Jun 24 08:46:34.200513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 352/701] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:46:33 2022] POST /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:34.306148 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-01b79be7-0e6a-4f6c-898e-94ab8c6417b8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:34.307457 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-01b79be7-0e6a-4f6c-898e-94ab8c6417b8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:34.315588 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b79be7-0e6a-4f6c-898e-94ab8c6417b8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:34.316039 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b79be7-0e6a-4f6c-898e-94ab8c6417b8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.316815 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b79be7-0e6a-4f6c-898e-94ab8c6417b8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:34.317303 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b79be7-0e6a-4f6c-898e-94ab8c6417b8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.349735 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-01b79be7-0e6a-4f6c-898e-94ab8c6417b8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047726 Jun 24 08:46:34.350593 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 350/702] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:46:34 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:46:34.452822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b915374b-53c6-46de-ba7a-32e4a711e8e3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:34.453432 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b915374b-53c6-46de-ba7a-32e4a711e8e3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:34.459916 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b915374b-53c6-46de-ba7a-32e4a711e8e3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:34.460369 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b915374b-53c6-46de-ba7a-32e4a711e8e3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.461158 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b915374b-53c6-46de-ba7a-32e4a711e8e3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:34.461644 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b915374b-53c6-46de-ba7a-32e4a711e8e3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.489441 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b915374b-53c6-46de-ba7a-32e4a711e8e3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:46:34.578726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b915374b-53c6-46de-ba7a-32e4a711e8e3 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 204 len: 0 microversion: 2.1 time: 0.130539 Jun 24 08:46:34.579745 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 353/703] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:46:34 2022] DELETE /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:46:34.588468 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6561c15f-7c62-4ef0-a3cf-1a270fadf4e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:34.589080 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6561c15f-7c62-4ef0-a3cf-1a270fadf4e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:34.595653 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6561c15f-7c62-4ef0-a3cf-1a270fadf4e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:34.596075 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6561c15f-7c62-4ef0-a3cf-1a270fadf4e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.596855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6561c15f-7c62-4ef0-a3cf-1a270fadf4e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:34.597292 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6561c15f-7c62-4ef0-a3cf-1a270fadf4e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.740554 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6561c15f-7c62-4ef0-a3cf-1a270fadf4e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:34.749084 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6561c15f-7c62-4ef0-a3cf-1a270fadf4e8 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1687 microversion: 2.1 time: 0.164195 Jun 24 08:46:34.749667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 351/704] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:34 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:35.666307 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d9278137-e542-4da5-9367-e36944265150 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:35.667107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d9278137-e542-4da5-9367-e36944265150 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:35.674029 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9278137-e542-4da5-9367-e36944265150 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.674484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9278137-e542-4da5-9367-e36944265150 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.675269 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9278137-e542-4da5-9367-e36944265150 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.675731 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9278137-e542-4da5-9367-e36944265150 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.702025 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d9278137-e542-4da5-9367-e36944265150 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:46:35.768173 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6f2b41a8-621b-4b4c-8d4b-b0a9254a3bd2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:35.769193 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6f2b41a8-621b-4b4c-8d4b-b0a9254a3bd2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:35.780401 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f2b41a8-621b-4b4c-8d4b-b0a9254a3bd2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.781313 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f2b41a8-621b-4b4c-8d4b-b0a9254a3bd2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.782728 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f2b41a8-621b-4b4c-8d4b-b0a9254a3bd2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.783500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f2b41a8-621b-4b4c-8d4b-b0a9254a3bd2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.792346 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d9278137-e542-4da5-9367-e36944265150 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "DELETE /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 204 len: 0 microversion: 2.1 time: 0.130044 Jun 24 08:46:35.793049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 354/705] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:46:35 2022] DELETE /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:46:35.802624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6a847929-5ada-4b2d-bfbc-ef90a34c0c2c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:35.803422 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6a847929-5ada-4b2d-bfbc-ef90a34c0c2c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:35.810050 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6a847929-5ada-4b2d-bfbc-ef90a34c0c2c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.810500 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6a847929-5ada-4b2d-bfbc-ef90a34c0c2c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.811291 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6a847929-5ada-4b2d-bfbc-ef90a34c0c2c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.811737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6a847929-5ada-4b2d-bfbc-ef90a34c0c2c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:36.024022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6a847929-5ada-4b2d-bfbc-ef90a34c0c2c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:36.031372 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6f2b41a8-621b-4b4c-8d4b-b0a9254a3bd2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:36.034391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6a847929-5ada-4b2d-bfbc-ef90a34c0c2c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1573 microversion: 2.1 time: 0.235902 Jun 24 08:46:36.035249 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 355/706] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:35 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1573 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:36.044739 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6f2b41a8-621b-4b4c-8d4b-b0a9254a3bd2 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1687 microversion: 2.1 time: 0.281594 Jun 24 08:46:36.047121 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 352/707] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:35 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1687 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:37.053610 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-32fcd7a7-f538-401d-9247-e92a2f4c3ec8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:37.054300 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-32fcd7a7-f538-401d-9247-e92a2f4c3ec8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:37.061081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32fcd7a7-f538-401d-9247-e92a2f4c3ec8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.061528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32fcd7a7-f538-401d-9247-e92a2f4c3ec8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.062378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32fcd7a7-f538-401d-9247-e92a2f4c3ec8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.062819 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32fcd7a7-f538-401d-9247-e92a2f4c3ec8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.072638 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a4e5ccf1-2b16-4ab2-afb4-0a85eb13c3bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:37.073338 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a4e5ccf1-2b16-4ab2-afb4-0a85eb13c3bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:37.081172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a4e5ccf1-2b16-4ab2-afb4-0a85eb13c3bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.081622 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a4e5ccf1-2b16-4ab2-afb4-0a85eb13c3bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.082450 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a4e5ccf1-2b16-4ab2-afb4-0a85eb13c3bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.082892 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a4e5ccf1-2b16-4ab2-afb4-0a85eb13c3bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.294630 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-32fcd7a7-f538-401d-9247-e92a2f4c3ec8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:37.302501 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-32fcd7a7-f538-401d-9247-e92a2f4c3ec8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1573 microversion: 2.1 time: 0.252712 Jun 24 08:46:37.303082 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 356/708] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:37 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1573 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:37.306435 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a4e5ccf1-2b16-4ab2-afb4-0a85eb13c3bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:37.314985 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a4e5ccf1-2b16-4ab2-afb4-0a85eb13c3bd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1687 microversion: 2.1 time: 0.246266 Jun 24 08:46:37.315570 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 353/709] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:37 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1687 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:38.320394 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d9c81244-b25a-40bd-81d5-7017b703f3a7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:38.320986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d9c81244-b25a-40bd-81d5-7017b703f3a7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:38.328919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9c81244-b25a-40bd-81d5-7017b703f3a7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.329364 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9c81244-b25a-40bd-81d5-7017b703f3a7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.330160 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9c81244-b25a-40bd-81d5-7017b703f3a7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.330603 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9c81244-b25a-40bd-81d5-7017b703f3a7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.332630 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-342ba3b5-674c-4926-895c-2fd6612292e6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:38.333252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-342ba3b5-674c-4926-895c-2fd6612292e6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:38.340401 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-342ba3b5-674c-4926-895c-2fd6612292e6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.340838 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-342ba3b5-674c-4926-895c-2fd6612292e6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.342071 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-342ba3b5-674c-4926-895c-2fd6612292e6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.342071 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-342ba3b5-674c-4926-895c-2fd6612292e6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.541330 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d9c81244-b25a-40bd-81d5-7017b703f3a7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:38.550415 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d9c81244-b25a-40bd-81d5-7017b703f3a7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1573 microversion: 2.1 time: 0.233503 Jun 24 08:46:38.550668 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-342ba3b5-674c-4926-895c-2fd6612292e6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:38.551004 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 357/710] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:38 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1573 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:38.567701 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-342ba3b5-674c-4926-895c-2fd6612292e6 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1687 microversion: 2.1 time: 0.238590 Jun 24 08:46:38.568837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 354/711] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:38 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1687 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:39.568625 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-106a49c8-78f2-405e-b900-a6bdc1feec1a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:39.569602 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-106a49c8-78f2-405e-b900-a6bdc1feec1a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:39.582243 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-106a49c8-78f2-405e-b900-a6bdc1feec1a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.582993 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-106a49c8-78f2-405e-b900-a6bdc1feec1a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.584242 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-106a49c8-78f2-405e-b900-a6bdc1feec1a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.584800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-106a49c8-78f2-405e-b900-a6bdc1feec1a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.596601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4859ca5b-a42d-4258-98a2-d1da8e1800ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:39.597623 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4859ca5b-a42d-4258-98a2-d1da8e1800ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:39.611942 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4859ca5b-a42d-4258-98a2-d1da8e1800ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.612707 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4859ca5b-a42d-4258-98a2-d1da8e1800ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.614050 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4859ca5b-a42d-4258-98a2-d1da8e1800ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.614832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4859ca5b-a42d-4258-98a2-d1da8e1800ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.830180 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-106a49c8-78f2-405e-b900-a6bdc1feec1a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:39.847439 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-106a49c8-78f2-405e-b900-a6bdc1feec1a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1573 microversion: 2.1 time: 0.282547 Jun 24 08:46:39.848696 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 358/712] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:39 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1573 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:39.932372 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4859ca5b-a42d-4258-98a2-d1da8e1800ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:39.947581 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4859ca5b-a42d-4258-98a2-d1da8e1800ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1687 microversion: 2.1 time: 0.358139 Jun 24 08:46:39.948296 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 355/713] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:39 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1687 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:40.844536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5afe83d5-0587-4c8c-93e2-8ca90825e651 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:40.847454 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5afe83d5-0587-4c8c-93e2-8ca90825e651 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:40.859957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5afe83d5-0587-4c8c-93e2-8ca90825e651 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.861117 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5afe83d5-0587-4c8c-93e2-8ca90825e651 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.863009 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5afe83d5-0587-4c8c-93e2-8ca90825e651 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.863984 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5afe83d5-0587-4c8c-93e2-8ca90825e651 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.874141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6ae06fa8-a406-4c79-a2ce-6cd6364af0e9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:40.876381 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6ae06fa8-a406-4c79-a2ce-6cd6364af0e9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:40.900225 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ae06fa8-a406-4c79-a2ce-6cd6364af0e9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.905989 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ae06fa8-a406-4c79-a2ce-6cd6364af0e9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.907443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ae06fa8-a406-4c79-a2ce-6cd6364af0e9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.908226 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ae06fa8-a406-4c79-a2ce-6cd6364af0e9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.932585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:40.951967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5afe83d5-0587-4c8c-93e2-8ca90825e651 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.114989 Jun 24 08:46:40.952754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 359/714] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:46:40 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:40.971666 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f42b1c8a-6bcd-40b1-b009-2a509987c1ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:40.972306 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f42b1c8a-6bcd-40b1-b009-2a509987c1ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:40.992398 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f42b1c8a-6bcd-40b1-b009-2a509987c1ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.992859 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f42b1c8a-6bcd-40b1-b009-2a509987c1ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.993709 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f42b1c8a-6bcd-40b1-b009-2a509987c1ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.994167 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f42b1c8a-6bcd-40b1-b009-2a509987c1ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.191372 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f42b1c8a-6bcd-40b1-b009-2a509987c1ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:41.210040 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f42b1c8a-6bcd-40b1-b009-2a509987c1ef tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 200 len: 1620 microversion: 2.1 time: 0.246133 Jun 24 08:46:41.211351 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 360/715] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:40 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 1620 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:41.240219 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-013be549-2e6d-48e9-9520-32f44516ba9a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:41.240823 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-013be549-2e6d-48e9-9520-32f44516ba9a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:41.258144 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-013be549-2e6d-48e9-9520-32f44516ba9a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.262071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-013be549-2e6d-48e9-9520-32f44516ba9a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.265852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-013be549-2e6d-48e9-9520-32f44516ba9a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.267033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-013be549-2e6d-48e9-9520-32f44516ba9a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.333602 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-013be549-2e6d-48e9-9520-32f44516ba9a tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/af4be984-d120-4372-97f6-067447344c47" status: 200 len: 194 microversion: 2.1 time: 0.120522 Jun 24 08:46:41.343442 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 361/716] 10.222.0.13 () {58 vars in 1412 bytes} [Fri Jun 24 08:46:41 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/af4be984-d120-4372-97f6-067447344c47 => generated 194 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:41.446149 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6ae06fa8-a406-4c79-a2ce-6cd6364af0e9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:41.465305 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6ae06fa8-a406-4c79-a2ce-6cd6364af0e9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1573 microversion: 2.1 time: 0.598270 Jun 24 08:46:41.467589 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 356/717] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:40 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1573 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:41.478992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-50043383-f776-4a55-bcd9-09e37987ae46 req-67661377-8597-41c6-96e7-197267c8a507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7b568a-ef02-4854-a5e2-96aa05ba02a9", "name": "network-vif-deleted", "tag": "3d39ea3a-6eab-4732-b461-bbfa249534b3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:41.483429 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-88e783ec-0dc8-43d9-bb6a-3f57c1693a49 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:41.484064 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-88e783ec-0dc8-43d9-bb6a-3f57c1693a49 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:41.495802 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-88e783ec-0dc8-43d9-bb6a-3f57c1693a49 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.496253 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-88e783ec-0dc8-43d9-bb6a-3f57c1693a49 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.497634 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-88e783ec-0dc8-43d9-bb6a-3f57c1693a49 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.498715 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-88e783ec-0dc8-43d9-bb6a-3f57c1693a49 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.499544 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-50043383-f776-4a55-bcd9-09e37987ae46 req-67661377-8597-41c6-96e7-197267c8a507 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.501287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-50043383-f776-4a55-bcd9-09e37987ae46 req-67661377-8597-41c6-96e7-197267c8a507 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.532291 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-50043383-f776-4a55-bcd9-09e37987ae46 req-67661377-8597-41c6-96e7-197267c8a507 service nova] Creating event network-vif-deleted:3d39ea3a-6eab-4732-b461-bbfa249534b3 for instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 on hv-cinder-84713 Jun 24 08:46:41.543065 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-50043383-f776-4a55-bcd9-09e37987ae46 req-67661377-8597-41c6-96e7-197267c8a507 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197221 Jun 24 08:46:41.545535 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 362/718] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:41.599814 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-88e783ec-0dc8-43d9-bb6a-3f57c1693a49 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lazy-loading 'services' on Instance uuid d400a3a2-9cc2-4ce5-959c-e45d459b58a9 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:46:41.705830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-88e783ec-0dc8-43d9-bb6a-3f57c1693a49 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/af4be984-d120-4372-97f6-067447344c47" status: 202 len: 0 microversion: 2.1 time: 0.226565 Jun 24 08:46:41.706776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 357/719] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:46:41 2022] DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/af4be984-d120-4372-97f6-067447344c47 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:46:42.240777 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:42.248175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 7c7b568a-ef02-4854-a5e2-96aa05ba02a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:42.280953 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.281900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.283344 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.284087 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.315247 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-7c9a181c-4d9f-4cb0-a801-bff05733702a req-2813da27-0e69-4d9f-8edc-2df39acecd86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343f4d48-6760-43ff-884e-cca72945b189", "name": "network-vif-deleted", "tag": "2d1085b8-f3d2-4d16-b60d-40af9929f641"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:42.345996 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] HTTP exception thrown: Instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 could not be found. Jun 24 08:46:42.351106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-7c9a181c-4d9f-4cb0-a801-bff05733702a req-2813da27-0e69-4d9f-8edc-2df39acecd86 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.351809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-7c9a181c-4d9f-4cb0-a801-bff05733702a req-2813da27-0e69-4d9f-8edc-2df39acecd86 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Request method failure captured: Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 HTTP/1.1 Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiVits7z_fNY9CIdaVGFwsyyojS1gN_005o09PgebDbafPXTjFtE0sMjdOvU7dXDThXGKu3RBAjPIRw6jmKgz9siH16jgnXL3L5kANDajWkrvFKUibt6kjc2oMQPduH420ivpFFX0X8yRrwy2kU5dysnMtxSK-KhekZ8UMKvyDfK_k Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:46:42.356531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dfa535df5dd14d69bb3ca125cbd9fe13", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 71e0fd73e5c9430c813af1de9ccd4a52 Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 could not be found. Jun 24 08:46:42.359141 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '7c7b568a-ef02-4854-a5e2-96aa05ba02a9'} Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 could not be found. Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:42.359969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 could not be found. Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 could not be found. Jun 24 08:46:42.361295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:42.375411 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-7c9a181c-4d9f-4cb0-a801-bff05733702a req-2813da27-0e69-4d9f-8edc-2df39acecd86 service nova] Creating event network-vif-deleted:2d1085b8-f3d2-4d16-b60d-40af9929f641 for instance 343f4d48-6760-43ff-884e-cca72945b189 on hv-cinder-84713 Jun 24 08:46:42.381381 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Returning 404 to user: Instance 7c7b568a-ef02-4854-a5e2-96aa05ba02a9 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:42.384329 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-339708e0-a236-4305-ae3c-5f1de5a7ec38 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9" status: 404 len: 111 microversion: 2.1 time: 0.149626 Jun 24 08:46:42.387476 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-7c9a181c-4d9f-4cb0-a801-bff05733702a req-2813da27-0e69-4d9f-8edc-2df39acecd86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203175 Jun 24 08:46:42.390186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 363/720] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:42.391905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 358/721] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:42 2022] GET /compute/v2.1/servers/7c7b568a-ef02-4854-a5e2-96aa05ba02a9 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:42.403128 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e660fa4e-0e86-430a-8ad8-1b2b00660b16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '.version_select at 0x7f0a6ff2a8b0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:42.434366 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e660fa4e-0e86-430a-8ad8-1b2b00660b16 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629404774" status: 202 len: 0 microversion: 2.1 time: 0.040588 Jun 24 08:46:42.435289 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 364/722] 10.222.0.13 () {58 vars in 1220 bytes} [Fri Jun 24 08:46:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629404774 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:46:42.485731 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3232ca1f-11a3-4bcb-bf27-06641e4d99da tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:42.486699 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3232ca1f-11a3-4bcb-bf27-06641e4d99da tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:42.494526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3232ca1f-11a3-4bcb-bf27-06641e4d99da tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.505207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3232ca1f-11a3-4bcb-bf27-06641e4d99da tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.507275 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3232ca1f-11a3-4bcb-bf27-06641e4d99da tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.507937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3232ca1f-11a3-4bcb-bf27-06641e4d99da tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.611398 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3232ca1f-11a3-4bcb-bf27-06641e4d99da tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:42.624040 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3232ca1f-11a3-4bcb-bf27-06641e4d99da tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 200 len: 1223 microversion: 2.1 time: 0.143936 Jun 24 08:46:42.639664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 359/723] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:42 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 1223 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:42.955043 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8f11d20b-6f63-4010-a491-36bb6900867b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:42.958933 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8f11d20b-6f63-4010-a491-36bb6900867b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:42.987964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f11d20b-6f63-4010-a491-36bb6900867b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.988310 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f11d20b-6f63-4010-a491-36bb6900867b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.991056 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f11d20b-6f63-4010-a491-36bb6900867b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.991555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f11d20b-6f63-4010-a491-36bb6900867b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:43.052461 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8f11d20b-6f63-4010-a491-36bb6900867b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/ips" status: 200 len: 149 microversion: 2.20 time: 0.113005 Jun 24 08:46:43.057481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 365/724] 10.222.0.13 () {60 vars in 1288 bytes} [Fri Jun 24 08:46:42 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/ips => generated 149 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:46:43.648195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:43.649517 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:43.678042 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:43.681373 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:43.681373 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:43.682591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:43.721330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] HTTP exception thrown: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Request method failure captured: Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 HTTP/1.1 Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXkPwkLod11faN8VrsNwsEcn7aw2Z0f3lZU8KNjPmDD6cDUq6c2knfVXnds3lCcAzi8KTpWCQ_vvHhrduOICuJhOVbWAKRCKYapVv3bwBGhDjW93pr7L43ugtUQzdf0ubCu9JRWopHnDdTlw3Vbe9ZXPeu65YukHT26fKFZEocu2wFM Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:46:43.725522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d0b95979aebe47bc92c387de59394942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d0b95979aebe47bc92c387de59394942", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: bf905723382e4372ae63d77a376982ff Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:46:43.727055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '343f4d48-6760-43ff-884e-cca72945b189'} Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:43.727960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:46:43.729300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:43.730332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Returning 404 to user: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:43.731123 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-32fda68e-e753-4c3a-8446-624a37714f63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 404 len: 111 microversion: 2.1 time: 0.088691 Jun 24 08:46:43.742277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 360/725] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:43 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:43.910518 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1510519932", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825893973", "security_groups": [{"name": "tempest-secgroup-smoke-404408504"}], "block_device_mapping_v2": [{"uuid": "247ee42e-9902-4ce2-936f-2f75308a91ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6af235bb-9dd2-419a-b173-c8cd5b4cf745"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:44.052522 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] validate_networks() for [('6af235bb-9dd2-419a-b173-c8cd5b4cf745', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:46:44.105765 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b4223c5f-a081-4de0-b648-9f7ea98cd9ff tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:44.106649 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b4223c5f-a081-4de0-b648-9f7ea98cd9ff tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:44.116210 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4223c5f-a081-4de0-b648-9f7ea98cd9ff tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.116663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4223c5f-a081-4de0-b648-9f7ea98cd9ff tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.117440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4223c5f-a081-4de0-b648-9f7ea98cd9ff tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.117917 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4223c5f-a081-4de0-b648-9f7ea98cd9ff tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.156551 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b4223c5f-a081-4de0-b648-9f7ea98cd9ff tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/1140d3c7-99f6-4236-b804-ca5f89eda1cc" status: 200 len: 194 microversion: 2.1 time: 0.058571 Jun 24 08:46:44.163120 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 361/726] 10.222.0.13 () {58 vars in 1412 bytes} [Fri Jun 24 08:46:44 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/1140d3c7-99f6-4236-b804-ca5f89eda1cc => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:46:44.171661 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-149c0386-cc72-4365-83b0-42a8e4efebe4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:44.172168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-149c0386-cc72-4365-83b0-42a8e4efebe4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:44.179243 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-149c0386-cc72-4365-83b0-42a8e4efebe4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.179695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-149c0386-cc72-4365-83b0-42a8e4efebe4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.180509 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-149c0386-cc72-4365-83b0-42a8e4efebe4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.181053 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-149c0386-cc72-4365-83b0-42a8e4efebe4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.267712 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:44.273846 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-149c0386-cc72-4365-83b0-42a8e4efebe4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lazy-loading 'services' on Instance uuid d400a3a2-9cc2-4ce5-959c-e45d459b58a9 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:46:44.363103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-149c0386-cc72-4365-83b0-42a8e4efebe4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/1140d3c7-99f6-4236-b804-ca5f89eda1cc" status: 202 len: 0 microversion: 2.1 time: 0.197910 Jun 24 08:46:44.364103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 362/727] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:46:44 2022] DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments/1140d3c7-99f6-4236-b804-ca5f89eda1cc => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:46:44.673488 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:46:44.673964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:46:44.674429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:46:44.674843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:46:44.675257 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:46:44.684652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.685110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.686532 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.687097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.706099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Getting quotas for project d0b95979aebe47bc92c387de59394942. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:46:44.710386 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Getting quotas for user bf905723382e4372ae63d77a376982ff and project d0b95979aebe47bc92c387de59394942. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:46:44.778693 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:46:44.782001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='247ee42e-9902-4ce2-936f-2f75308a91ae',volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:46:44.980631 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-96c91e10-c435-4745-9211-2934aab4024c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.075055 Jun 24 08:46:44.981882 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 366/728] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:46:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:46:45.002868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-25b342c0-53bb-442a-b16f-5867c0f4621d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:45.006177 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-25b342c0-53bb-442a-b16f-5867c0f4621d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:45.101709 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-25b342c0-53bb-442a-b16f-5867c0f4621d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:45.114678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-25b342c0-53bb-442a-b16f-5867c0f4621d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1094 microversion: 2.1 time: 0.121814 Jun 24 08:46:45.115467 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 363/729] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:44 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:45.655577 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-73111a8c-e3ff-4ee1-a39f-d6a0bca8e1ce tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:45.656787 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-73111a8c-e3ff-4ee1-a39f-d6a0bca8e1ce tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:45.666605 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73111a8c-e3ff-4ee1-a39f-d6a0bca8e1ce tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.667057 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73111a8c-e3ff-4ee1-a39f-d6a0bca8e1ce tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.667844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73111a8c-e3ff-4ee1-a39f-d6a0bca8e1ce tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.668285 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73111a8c-e3ff-4ee1-a39f-d6a0bca8e1ce tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.704534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-73111a8c-e3ff-4ee1-a39f-d6a0bca8e1ce tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055180 Jun 24 08:46:45.705554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 367/730] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:46:45 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:46:45.882683 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5aec316c-7991-4072-994c-82156df1ecdc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:45.887637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5aec316c-7991-4072-994c-82156df1ecdc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:45.902235 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5aec316c-7991-4072-994c-82156df1ecdc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.903096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5aec316c-7991-4072-994c-82156df1ecdc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.907029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5aec316c-7991-4072-994c-82156df1ecdc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.907029 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5aec316c-7991-4072-994c-82156df1ecdc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.916992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f1ee9d47-c1ce-4896-9ced-deee2ab0581e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:45.918340 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f1ee9d47-c1ce-4896-9ced-deee2ab0581e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:45.931816 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1ee9d47-c1ce-4896-9ced-deee2ab0581e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.932971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1ee9d47-c1ce-4896-9ced-deee2ab0581e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.934787 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1ee9d47-c1ce-4896-9ced-deee2ab0581e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.936517 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1ee9d47-c1ce-4896-9ced-deee2ab0581e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.952207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5aec316c-7991-4072-994c-82156df1ecdc tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077853 Jun 24 08:46:45.954285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 364/731] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:46:45 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:46:45.998624 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-f1ee9d47-c1ce-4896-9ced-deee2ab0581e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lazy-loading 'flavor' on Instance uuid c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:46:46.043636 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-abd06526-cbb1-4621-8135-03b527badc8d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:46.044518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-abd06526-cbb1-4621-8135-03b527badc8d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:46.055920 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-abd06526-cbb1-4621-8135-03b527badc8d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.056676 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-abd06526-cbb1-4621-8135-03b527badc8d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.058267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-abd06526-cbb1-4621-8135-03b527badc8d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.058999 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-abd06526-cbb1-4621-8135-03b527badc8d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.096436 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-abd06526-cbb1-4621-8135-03b527badc8d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:46:46.218657 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-abd06526-cbb1-4621-8135-03b527badc8d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 204 len: 0 microversion: 2.1 time: 0.177526 Jun 24 08:46:46.219783 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 365/732] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:46:46 2022] DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:46:46.229459 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d8b72cb4-0a9c-44d0-b8c6-130252a1af24 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:46.230710 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d8b72cb4-0a9c-44d0-b8c6-130252a1af24 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:46.239758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8b72cb4-0a9c-44d0-b8c6-130252a1af24 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.240524 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8b72cb4-0a9c-44d0-b8c6-130252a1af24 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.241312 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8b72cb4-0a9c-44d0-b8c6-130252a1af24 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.241779 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8b72cb4-0a9c-44d0-b8c6-130252a1af24 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.322269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8b72cb4-0a9c-44d0-b8c6-130252a1af24 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:46.338563 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d8b72cb4-0a9c-44d0-b8c6-130252a1af24 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1192 microversion: 2.1 time: 0.116515 Jun 24 08:46:46.340030 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 366/733] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:46 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1192 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:46.368168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3891a2f6-0037-426e-a0be-2c3975e78cb4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:46.369014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3891a2f6-0037-426e-a0be-2c3975e78cb4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:46.381043 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3891a2f6-0037-426e-a0be-2c3975e78cb4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.381876 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3891a2f6-0037-426e-a0be-2c3975e78cb4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.383210 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3891a2f6-0037-426e-a0be-2c3975e78cb4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.383986 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3891a2f6-0037-426e-a0be-2c3975e78cb4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.405305 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f1ee9d47-c1ce-4896-9ced-deee2ab0581e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/action" status: 202 len: 0 microversion: 2.20 time: 0.495889 Jun 24 08:46:46.406362 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 368/734] 10.222.0.13 () {62 vars in 1318 bytes} [Fri Jun 24 08:46:45 2022] POST /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:46:46.412195 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9b6027ec-6828-4536-83c9-735986f18a5d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:46.413440 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9b6027ec-6828-4536-83c9-735986f18a5d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:46.425025 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9b6027ec-6828-4536-83c9-735986f18a5d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.426210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9b6027ec-6828-4536-83c9-735986f18a5d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.428052 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9b6027ec-6828-4536-83c9-735986f18a5d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.428840 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9b6027ec-6828-4536-83c9-735986f18a5d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.436905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3891a2f6-0037-426e-a0be-2c3975e78cb4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:46:46.528031 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3891a2f6-0037-426e-a0be-2c3975e78cb4 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 204 len: 0 microversion: 2.1 time: 0.172006 Jun 24 08:46:46.528942 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 367/735] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:46:46 2022] DELETE /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:46:46.539622 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:46.540734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:46.548874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.549301 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.550140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.550582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.670967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9b6027ec-6828-4536-83c9-735986f18a5d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:46.684005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9b6027ec-6828-4536-83c9-735986f18a5d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1673 microversion: 2.1 time: 0.275797 Jun 24 08:46:46.685102 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 369/736] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:46 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1673 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:46.694058 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ed092744-4713-488b-a797-379e83759679 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:46.695246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ed092744-4713-488b-a797-379e83759679 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:46.706725 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ed092744-4713-488b-a797-379e83759679 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.707525 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ed092744-4713-488b-a797-379e83759679 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.708971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ed092744-4713-488b-a797-379e83759679 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.709781 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ed092744-4713-488b-a797-379e83759679 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.751151 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:46.767557 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:46.770968 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:46.773219 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5870f3e4-92a3-4a43-876b-0050f5585283 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.238088 Jun 24 08:46:46.774291 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 368/737] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:46 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:46.864332 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ed092744-4713-488b-a797-379e83759679 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:46.872491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ed092744-4713-488b-a797-379e83759679 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1506 microversion: 2.1 time: 0.185664 Jun 24 08:46:46.873156 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 370/738] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:46 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:47.371568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-090bec31-28ff-4b08-968a-559a148f443a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:47.372750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-090bec31-28ff-4b08-968a-559a148f443a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:47.385225 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-090bec31-28ff-4b08-968a-559a148f443a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.386043 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-090bec31-28ff-4b08-968a-559a148f443a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.387363 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-090bec31-28ff-4b08-968a-559a148f443a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.388117 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-090bec31-28ff-4b08-968a-559a148f443a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.480260 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-090bec31-28ff-4b08-968a-559a148f443a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:47.489809 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-090bec31-28ff-4b08-968a-559a148f443a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1200 microversion: 2.1 time: 0.125065 Jun 24 08:46:47.490438 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 369/739] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:47 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1200 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:47.704314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cd94972b-8edb-4314-9524-f86b1476af06 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:47.704966 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cd94972b-8edb-4314-9524-f86b1476af06 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:47.711629 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd94972b-8edb-4314-9524-f86b1476af06 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.712072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd94972b-8edb-4314-9524-f86b1476af06 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.712843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd94972b-8edb-4314-9524-f86b1476af06 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.713283 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cd94972b-8edb-4314-9524-f86b1476af06 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.802572 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:47.803254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:47.809722 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.810178 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.811926 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.812486 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.270963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.274257 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cd94972b-8edb-4314-9524-f86b1476af06 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.281452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.282565 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cd94972b-8edb-4314-9524-f86b1476af06 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1673 microversion: 2.1 time: 0.583219 Jun 24 08:46:48.283010 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.283323 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 371/740] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:47 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1673 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:48.284330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e6d137e1-5385-417a-8b63-8d9ccb8ae57b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.486169 Jun 24 08:46:48.285142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 370/741] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:47 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:46:48.288166 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e44efb5d-8f7b-49be-8ee9-35a1b2f76c44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:48.288780 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e44efb5d-8f7b-49be-8ee9-35a1b2f76c44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:48.295764 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e44efb5d-8f7b-49be-8ee9-35a1b2f76c44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.296208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e44efb5d-8f7b-49be-8ee9-35a1b2f76c44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.296990 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e44efb5d-8f7b-49be-8ee9-35a1b2f76c44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.297428 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e44efb5d-8f7b-49be-8ee9-35a1b2f76c44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.434636 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e44efb5d-8f7b-49be-8ee9-35a1b2f76c44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.443320 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e44efb5d-8f7b-49be-8ee9-35a1b2f76c44 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1506 microversion: 2.1 time: 0.158789 Jun 24 08:46:48.443897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 372/742] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:48 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:48.509169 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e18d96c6-b4f6-41a7-ac0d-899ad5bcd0b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:48.509805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e18d96c6-b4f6-41a7-ac0d-899ad5bcd0b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:48.516809 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e18d96c6-b4f6-41a7-ac0d-899ad5bcd0b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.517246 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e18d96c6-b4f6-41a7-ac0d-899ad5bcd0b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.518041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e18d96c6-b4f6-41a7-ac0d-899ad5bcd0b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.518470 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e18d96c6-b4f6-41a7-ac0d-899ad5bcd0b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.585412 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e18d96c6-b4f6-41a7-ac0d-899ad5bcd0b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.597805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e18d96c6-b4f6-41a7-ac0d-899ad5bcd0b7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1210 microversion: 2.1 time: 0.092089 Jun 24 08:46:48.598617 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 371/743] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:48 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:49.305178 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:49.306874 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:49.308433 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ab8ce823-4a9f-4277-8823-bbf954142f68 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:49.309652 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ab8ce823-4a9f-4277-8823-bbf954142f68 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:49.320635 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.321449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.322079 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ab8ce823-4a9f-4277-8823-bbf954142f68 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.323007 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.323129 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ab8ce823-4a9f-4277-8823-bbf954142f68 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.323956 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.324642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ab8ce823-4a9f-4277-8823-bbf954142f68 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.325508 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ab8ce823-4a9f-4277-8823-bbf954142f68 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.642592 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:49.663557 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:49.665166 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:49.668491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-772e32e0-65a2-43e0-8510-96ddb0485ab1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.367893 Jun 24 08:46:49.673855 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 373/744] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:49 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:49.674702 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ab8ce823-4a9f-4277-8823-bbf954142f68 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:49.679959 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-76ba77c9-17c5-4cae-9333-53c9c2261f83 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:49.680949 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-76ba77c9-17c5-4cae-9333-53c9c2261f83 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:49.691983 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76ba77c9-17c5-4cae-9333-53c9c2261f83 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.692641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76ba77c9-17c5-4cae-9333-53c9c2261f83 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.693482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76ba77c9-17c5-4cae-9333-53c9c2261f83 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.693971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76ba77c9-17c5-4cae-9333-53c9c2261f83 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.703692 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ab8ce823-4a9f-4277-8823-bbf954142f68 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1673 microversion: 2.1 time: 0.402078 Jun 24 08:46:49.706870 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 372/745] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:49 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1673 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:49.713923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b8d06f59-759d-4901-b072-96788cac8318 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:49.714665 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b8d06f59-759d-4901-b072-96788cac8318 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:49.724590 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8d06f59-759d-4901-b072-96788cac8318 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.725187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8d06f59-759d-4901-b072-96788cac8318 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.726166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8d06f59-759d-4901-b072-96788cac8318 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.726705 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8d06f59-759d-4901-b072-96788cac8318 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.884377 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b8d06f59-759d-4901-b072-96788cac8318 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:49.893637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b8d06f59-759d-4901-b072-96788cac8318 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1210 microversion: 2.1 time: 0.185511 Jun 24 08:46:49.903885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 373/746] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:49 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1210 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:50.121529 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-4c8e2cb4-51c6-4ddf-a782-5db0724cd4e4 req-deade50b-0ef9-48d3-b20a-04212fe91c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16405cd6-0d3f-4ea7-9972-e8d1588ff058", "name": "network-vif-deleted", "tag": "e99f3915-dc1e-4d3a-8acc-b64cbbda9e3b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:50.139738 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4c8e2cb4-51c6-4ddf-a782-5db0724cd4e4 req-deade50b-0ef9-48d3-b20a-04212fe91c5d service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.141243 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4c8e2cb4-51c6-4ddf-a782-5db0724cd4e4 req-deade50b-0ef9-48d3-b20a-04212fe91c5d service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.170922 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-76ba77c9-17c5-4cae-9333-53c9c2261f83 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:50.180661 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-4c8e2cb4-51c6-4ddf-a782-5db0724cd4e4 req-deade50b-0ef9-48d3-b20a-04212fe91c5d service nova] Creating event network-vif-deleted:e99f3915-dc1e-4d3a-8acc-b64cbbda9e3b for instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 on hv-cinder-84713 Jun 24 08:46:50.188234 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-4c8e2cb4-51c6-4ddf-a782-5db0724cd4e4 req-deade50b-0ef9-48d3-b20a-04212fe91c5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073471 Jun 24 08:46:50.195952 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 374/747] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:50.206076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-76ba77c9-17c5-4cae-9333-53c9c2261f83 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 200 len: 1506 microversion: 2.1 time: 0.534004 Jun 24 08:46:50.209962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 374/748] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:49 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:50.693990 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:50.695250 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:50.705323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.706209 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.707695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.708032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.739364 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-da24baac-32b1-4849-8685-a3a42a2aeca2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:50.741418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-da24baac-32b1-4849-8685-a3a42a2aeca2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:50.758844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da24baac-32b1-4849-8685-a3a42a2aeca2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.760809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da24baac-32b1-4849-8685-a3a42a2aeca2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.764060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da24baac-32b1-4849-8685-a3a42a2aeca2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.764935 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da24baac-32b1-4849-8685-a3a42a2aeca2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.172110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:51.191659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:51.195101 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:51.197328 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ab46c26-e9e3-454d-8197-9fd17028136c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.512235 Jun 24 08:46:51.198419 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 375/749] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:50 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:51.215096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-75e0e801-9b20-452f-ae7e-4d7f31c4624e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:51.216609 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-75e0e801-9b20-452f-ae7e-4d7f31c4624e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:51.229432 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75e0e801-9b20-452f-ae7e-4d7f31c4624e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.230254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75e0e801-9b20-452f-ae7e-4d7f31c4624e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.231957 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75e0e801-9b20-452f-ae7e-4d7f31c4624e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.233540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75e0e801-9b20-452f-ae7e-4d7f31c4624e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.269261 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-da24baac-32b1-4849-8685-a3a42a2aeca2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:51.281253 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-da24baac-32b1-4849-8685-a3a42a2aeca2 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1673 microversion: 2.1 time: 0.552799 Jun 24 08:46:51.281964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 375/750] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:50 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1673 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:51.289292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:51.289934 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 16405cd6-0d3f-4ea7-9972-e8d1588ff058] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:51.308942 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.309457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.310183 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.310863 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.329562 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] HTTP exception thrown: Instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 could not be found. Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Request method failure captured: Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 HTTP/1.1 Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiVits7z_fNY9CIdaVGFwsyyojS1gN_005o09PgebDbafPXTjFtE0sMjdOvU7dXDThXGKu3RBAjPIRw6jmKgz9siH16jgnXL3L5kANDajWkrvFKUibt6kjc2oMQPduH420ivpFFX0X8yRrwy2kU5dysnMtxSK-KhekZ8UMKvyDfK_k Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:46:51.331481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dfa535df5dd14d69bb3ca125cbd9fe13", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 71e0fd73e5c9430c813af1de9ccd4a52 Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 could not be found. Jun 24 08:46:51.334093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '16405cd6-0d3f-4ea7-9972-e8d1588ff058'} Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 could not be found. Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:51.336614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 could not be found. Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 could not be found. Jun 24 08:46:51.340138 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:51.344005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Returning 404 to user: Instance 16405cd6-0d3f-4ea7-9972-e8d1588ff058 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:51.344005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5023ac47-2356-4e2b-be67-2e9aac2f8b25 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058" status: 404 len: 111 microversion: 2.1 time: 0.049821 Jun 24 08:46:51.344005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 376/751] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:51 2022] GET /compute/v2.1/servers/16405cd6-0d3f-4ea7-9972-e8d1588ff058 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:51.345451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f8141319-9967-44b2-83f8-a05e1029ed3f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:51.346175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f8141319-9967-44b2-83f8-a05e1029ed3f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:51.360870 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8141319-9967-44b2-83f8-a05e1029ed3f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.361723 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8141319-9967-44b2-83f8-a05e1029ed3f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.363541 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8141319-9967-44b2-83f8-a05e1029ed3f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.364311 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8141319-9967-44b2-83f8-a05e1029ed3f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.396890 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f8141319-9967-44b2-83f8-a05e1029ed3f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:46:51.412342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:51.499141 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f8141319-9967-44b2-83f8-a05e1029ed3f tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 204 len: 0 microversion: 2.1 time: 0.158056 Jun 24 08:46:51.503833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 377/752] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:46:51 2022] DELETE /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:46:51.511683 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-429e601b-a503-4498-b156-e71a3d6cc12e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:51.512468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-429e601b-a503-4498-b156-e71a3d6cc12e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:51.526416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-429e601b-a503-4498-b156-e71a3d6cc12e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.526765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-429e601b-a503-4498-b156-e71a3d6cc12e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.527590 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-429e601b-a503-4498-b156-e71a3d6cc12e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.528033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-429e601b-a503-4498-b156-e71a3d6cc12e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.695620 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-75e0e801-9b20-452f-ae7e-4d7f31c4624e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:51.707353 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-75e0e801-9b20-452f-ae7e-4d7f31c4624e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.507094 Jun 24 08:46:51.708169 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 376/753] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:51 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:51.987703 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-429e601b-a503-4498-b156-e71a3d6cc12e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:52.003015 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-429e601b-a503-4498-b156-e71a3d6cc12e tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.497269 Jun 24 08:46:52.004454 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 378/754] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:51 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:52.085398 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-9d56e7ba-4cc1-44e0-9170-f0fec6f8129c req-d0234760-7a91-47af-a95e-0317f96793c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d400a3a2-9cc2-4ce5-959c-e45d459b58a9", "name": "network-vif-deleted", "tag": "c281cf91-0715-4eb4-ba74-fb499c317db3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:52.102087 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9d56e7ba-4cc1-44e0-9170-f0fec6f8129c req-d0234760-7a91-47af-a95e-0317f96793c0 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.103241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9d56e7ba-4cc1-44e0-9170-f0fec6f8129c req-d0234760-7a91-47af-a95e-0317f96793c0 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.111744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:52.129680 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-9d56e7ba-4cc1-44e0-9170-f0fec6f8129c req-d0234760-7a91-47af-a95e-0317f96793c0 service nova] Creating event network-vif-deleted:c281cf91-0715-4eb4-ba74-fb499c317db3 for instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 on hv-cinder-84713 Jun 24 08:46:52.139017 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-9d56e7ba-4cc1-44e0-9170-f0fec6f8129c req-d0234760-7a91-47af-a95e-0317f96793c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059974 Jun 24 08:46:52.140944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 377/755] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:52.225801 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:52.227106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:52.239753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.240914 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.242538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.243580 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.319878 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9ccd32d8-4bfc-4688-8602-ecb147380d0d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:52.321577 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9ccd32d8-4bfc-4688-8602-ecb147380d0d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:52.335772 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ccd32d8-4bfc-4688-8602-ecb147380d0d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.336546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ccd32d8-4bfc-4688-8602-ecb147380d0d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.338470 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ccd32d8-4bfc-4688-8602-ecb147380d0d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.339505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ccd32d8-4bfc-4688-8602-ecb147380d0d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.533883 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9ccd32d8-4bfc-4688-8602-ecb147380d0d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:52.549917 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9ccd32d8-4bfc-4688-8602-ecb147380d0d tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1605 microversion: 2.1 time: 0.240040 Jun 24 08:46:52.551385 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 378/756] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:52 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:52.709411 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:52.728052 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:52.735028 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:52.735815 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-42ccf791-af7a-4125-b24f-70bbb8f2e138 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:52.736939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-42ccf791-af7a-4125-b24f-70bbb8f2e138 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:52.739071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-32dc27dd-15ae-4e41-b98b-b852598c4e8c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.521975 Jun 24 08:46:52.741211 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 379/757] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:52 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:52.770361 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42ccf791-af7a-4125-b24f-70bbb8f2e138 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.771120 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42ccf791-af7a-4125-b24f-70bbb8f2e138 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.772803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42ccf791-af7a-4125-b24f-70bbb8f2e138 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.773831 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42ccf791-af7a-4125-b24f-70bbb8f2e138 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.030786 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fbb55da9-1d53-4b4e-ae0d-8ca1ee5809cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:53.032103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fbb55da9-1d53-4b4e-ae0d-8ca1ee5809cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:53.037741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:53.042495 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fbb55da9-1d53-4b4e-ae0d-8ca1ee5809cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.044209 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fbb55da9-1d53-4b4e-ae0d-8ca1ee5809cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.046090 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fbb55da9-1d53-4b4e-ae0d-8ca1ee5809cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.046727 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fbb55da9-1d53-4b4e-ae0d-8ca1ee5809cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.141245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-42ccf791-af7a-4125-b24f-70bbb8f2e138 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.159339 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-42ccf791-af7a-4125-b24f-70bbb8f2e138 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.435272 Jun 24 08:46:53.161058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 379/758] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:52 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:53.289639 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fbb55da9-1d53-4b4e-ae0d-8ca1ee5809cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.305308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fbb55da9-1d53-4b4e-ae0d-8ca1ee5809cd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.279854 Jun 24 08:46:53.308372 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 380/759] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:53 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:53.578517 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-35c1ff6e-141b-4f41-be6e-7f0582682517 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:53.579193 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-35c1ff6e-141b-4f41-be6e-7f0582682517 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:53.581345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:53.588552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35c1ff6e-141b-4f41-be6e-7f0582682517 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.589317 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35c1ff6e-141b-4f41-be6e-7f0582682517 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.590177 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35c1ff6e-141b-4f41-be6e-7f0582682517 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.590609 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35c1ff6e-141b-4f41-be6e-7f0582682517 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.706660 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-35c1ff6e-141b-4f41-be6e-7f0582682517 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71cbad05d1a54b4b9959e2ebbcb720fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2988ac4c59124e02bbcc7049e69dd599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.715384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-35c1ff6e-141b-4f41-be6e-7f0582682517 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 200 len: 1321 microversion: 2.1 time: 0.141522 Jun 24 08:46:53.715995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 380/760] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:53 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 1321 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:53.770935 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:53.771741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:53.779897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.780766 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.781596 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.782077 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.965324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.974674 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.976215 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.977444 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f64fc33a-a731-4360-9208-0669acb66a25 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.210714 Jun 24 08:46:53.978067 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 381/761] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:53 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:54.178558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9bb77d32-5a56-4e63-bf8d-63466d117131 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:54.179502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9bb77d32-5a56-4e63-bf8d-63466d117131 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:54.187366 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9bb77d32-5a56-4e63-bf8d-63466d117131 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.187824 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9bb77d32-5a56-4e63-bf8d-63466d117131 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.188651 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9bb77d32-5a56-4e63-bf8d-63466d117131 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.189123 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9bb77d32-5a56-4e63-bf8d-63466d117131 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.329584 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7f2d2c5f-469b-4c71-98d4-20c62bc758ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:54.330361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7f2d2c5f-469b-4c71-98d4-20c62bc758ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:54.337071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f2d2c5f-469b-4c71-98d4-20c62bc758ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.337523 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f2d2c5f-469b-4c71-98d4-20c62bc758ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.338341 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f2d2c5f-469b-4c71-98d4-20c62bc758ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.338778 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f2d2c5f-469b-4c71-98d4-20c62bc758ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.695128 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:54.717604 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:54.799144 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9bb77d32-5a56-4e63-bf8d-63466d117131 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:54.808020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9bb77d32-5a56-4e63-bf8d-63466d117131 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.633513 Jun 24 08:46:54.812164 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7f2d2c5f-469b-4c71-98d4-20c62bc758ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:54.823948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 381/762] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:54 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:54.829415 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-4cb0da81-531e-4e34-b58a-832d26cc7446 req-2ba7e940-be6c-4a4c-9bb0-6e81aa8031fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345", "tag": "c876251e-542e-4240-b1d0-e6e3647c3f3c"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:54.846204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7f2d2c5f-469b-4c71-98d4-20c62bc758ad tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1521 microversion: 2.1 time: 0.521455 Jun 24 08:46:54.846521 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4cb0da81-531e-4e34-b58a-832d26cc7446 req-2ba7e940-be6c-4a4c-9bb0-6e81aa8031fc service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.846965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4cb0da81-531e-4e34-b58a-832d26cc7446 req-2ba7e940-be6c-4a4c-9bb0-6e81aa8031fc service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.848099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 382/763] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:54 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:54.855240 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:54.856055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:54.867444 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.868417 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.870059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.870895 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-4cb0da81-531e-4e34-b58a-832d26cc7446 req-2ba7e940-be6c-4a4c-9bb0-6e81aa8031fc service nova] Creating event network-changed:c876251e-542e-4240-b1d0-e6e3647c3f3c for instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 on hv-cinder-84713 Jun 24 08:46:54.871084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.877742 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-4cb0da81-531e-4e34-b58a-832d26cc7446 req-2ba7e940-be6c-4a4c-9bb0-6e81aa8031fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052032 Jun 24 08:46:54.879673 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 382/764] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:54.900630 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] HTTP exception thrown: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Request method failure captured: Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 HTTP/1.1 Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiROebkf1QCea3YVodDpKh-is4p5qLxKDLYCitbrUiGHFx2WqeKpQcpQftUKpeSnCljbVtENK_PztSqjnxwOJA3A-3jWaF4bMc7tSslSE9_6qfDD95T0B2Xwlkk31c8_4KGoS6_WY_TerU67VW8P3U-3yucGNKqnickPVVDyfz1rMw Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:46:54.903808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2988ac4c59124e02bbcc7049e69dd599", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 71cbad05d1a54b4b9959e2ebbcb720fd Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:54.906747 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'd400a3a2-9cc2-4ce5-959c-e45d459b58a9'} Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:54.908174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:54.910842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:54.914182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Returning 404 to user: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:54.914182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ee472c80-8e0e-4330-a669-0f5e71e6d044 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 404 len: 111 microversion: 2.1 time: 0.056765 Jun 24 08:46:54.914539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 383/765] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:54 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:54.925592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-85fb26a8-ba56-4a1f-adea-5d892a9149af tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '.version_select at 0x7f0a7c77fe50>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:54.956617 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-85fb26a8-ba56-4a1f-adea-5d892a9149af tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-801070813" status: 202 len: 0 microversion: 2.1 time: 0.040916 Jun 24 08:46:54.957631 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 383/766] 10.222.0.13 () {58 vars in 1217 bytes} [Fri Jun 24 08:46:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-801070813 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:46:55.000853 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:55.001763 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:55.009060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.009990 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.011037 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.011861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.402019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:55.419029 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:55.422766 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:55.424511 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-15f6f6c4-8a91-469e-90fb-3c5590b0990e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.430500 Jun 24 08:46:55.425212 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 384/767] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:54 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:55.847316 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:55.857603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ad7301ac-7e53-468d-b7db-79791447c534 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:55.859686 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ad7301ac-7e53-468d-b7db-79791447c534 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:55.866678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:55.868159 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:55.873237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad7301ac-7e53-468d-b7db-79791447c534 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.874393 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad7301ac-7e53-468d-b7db-79791447c534 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.875846 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad7301ac-7e53-468d-b7db-79791447c534 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.876878 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad7301ac-7e53-468d-b7db-79791447c534 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.882370 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.883293 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.884923 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.885900 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.933711 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.934247 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.934802 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lazy-loading 'fault' on Instance uuid 01ede17c-58db-4ce0-a48f-de711078fbee {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:46:56.039022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0fd73e5c9430c813af1de9ccd4a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa535df5dd14d69bb3ca125cbd9fe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:56.049278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-76b83dce-6f39-436f-a603-6f7c035f2dfd tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 200 len: 1311 microversion: 2.1 time: 0.187414 Jun 24 08:46:56.059772 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 385/768] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:55 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 1311 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:56.216011 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ad7301ac-7e53-468d-b7db-79791447c534 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:56.224833 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ad7301ac-7e53-468d-b7db-79791447c534 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.379175 Jun 24 08:46:56.225417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 384/769] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:55 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:56.444608 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:56.445223 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:56.452223 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.452676 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:56.453459 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.453933 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:56.595533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:56.603879 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:56.605408 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:56.606607 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f6d572d4-20d6-42be-b66a-13dd5ac3a5a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.166037 Jun 24 08:46:56.607275 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 386/770] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:56 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:56.895853 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-03256d03-5108-4f50-9cd1-7efe381e5bec req-d2374faa-28aa-4fe2-89df-c4d8d934f22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ede17c-58db-4ce0-a48f-de711078fbee", "name": "network-vif-deleted", "tag": "71b1737d-30c3-4030-bd5c-8f8f4cd87144"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:56.905389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-03256d03-5108-4f50-9cd1-7efe381e5bec req-d2374faa-28aa-4fe2-89df-c4d8d934f22a service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.905874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-03256d03-5108-4f50-9cd1-7efe381e5bec req-d2374faa-28aa-4fe2-89df-c4d8d934f22a service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:56.917269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-03256d03-5108-4f50-9cd1-7efe381e5bec req-d2374faa-28aa-4fe2-89df-c4d8d934f22a service nova] Creating event network-vif-deleted:71b1737d-30c3-4030-bd5c-8f8f4cd87144 for instance 01ede17c-58db-4ce0-a48f-de711078fbee on hv-cinder-84713 Jun 24 08:46:56.923112 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-03256d03-5108-4f50-9cd1-7efe381e5bec req-d2374faa-28aa-4fe2-89df-c4d8d934f22a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031009 Jun 24 08:46:56.924095 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 385/771] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:57.067386 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:57.067999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] [instance: 01ede17c-58db-4ce0-a48f-de711078fbee] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:57.074101 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.074549 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.075322 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.076417 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.091097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] HTTP exception thrown: Instance 01ede17c-58db-4ce0-a48f-de711078fbee could not be found. Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Request method failure captured: Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee HTTP/1.1 Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiVits7z_fNY9CIdaVGFwsyyojS1gN_005o09PgebDbafPXTjFtE0sMjdOvU7dXDThXGKu3RBAjPIRw6jmKgz9siH16jgnXL3L5kANDajWkrvFKUibt6kjc2oMQPduH420ivpFFX0X8yRrwy2kU5dysnMtxSK-KhekZ8UMKvyDfK_k Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:46:57.092850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dfa535df5dd14d69bb3ca125cbd9fe13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dfa535df5dd14d69bb3ca125cbd9fe13", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: dfa535df5dd14d69bb3ca125cbd9fe13 Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040335818 Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 71e0fd73e5c9430c813af1de9ccd4a52 Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040335818-project Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 01ede17c-58db-4ce0-a48f-de711078fbee could not be found. Jun 24 08:46:57.095392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '01ede17c-58db-4ce0-a48f-de711078fbee'} Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ede17c-58db-4ce0-a48f-de711078fbee could not be found. Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:57.097230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ede17c-58db-4ce0-a48f-de711078fbee could not be found. Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ede17c-58db-4ce0-a48f-de711078fbee could not be found. Jun 24 08:46:57.099714 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:57.102287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] Returning 404 to user: Instance 01ede17c-58db-4ce0-a48f-de711078fbee could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:57.102287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b94736a2-ef85-4166-9972-02a68a269432 tempest-ServerRescueNegativeTestJSON-1040335818 tempest-ServerRescueNegativeTestJSON-1040335818-project] 10.222.0.13 "GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee" status: 404 len: 111 microversion: 2.1 time: 0.030833 Jun 24 08:46:57.102287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 387/772] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:57 2022] GET /compute/v2.1/servers/01ede17c-58db-4ce0-a48f-de711078fbee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:57.250071 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-66640a7d-708f-4e48-acdf-c12221143e23 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:57.251589 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-66640a7d-708f-4e48-acdf-c12221143e23 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:57.262782 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66640a7d-708f-4e48-acdf-c12221143e23 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.264562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66640a7d-708f-4e48-acdf-c12221143e23 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.266064 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66640a7d-708f-4e48-acdf-c12221143e23 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.266850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66640a7d-708f-4e48-acdf-c12221143e23 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.468299 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-66640a7d-708f-4e48-acdf-c12221143e23 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:57.477738 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-66640a7d-708f-4e48-acdf-c12221143e23 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.235636 Jun 24 08:46:57.478436 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 386/773] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:57 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:57.625914 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:57.627066 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:57.639852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.639852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.641069 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.641883 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.839017 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:57.848568 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:57.850284 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:57.851560 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a53241db-fd52-40c9-bcd7-fb7b47b13857 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.230737 Jun 24 08:46:57.852219 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 388/774] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:57 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:46:58.264323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:58.265160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:58.273253 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.273963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.274766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.275300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.293205 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] HTTP exception thrown: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Request method failure captured: Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 HTTP/1.1 Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiROebkf1QCea3YVodDpKh-is4p5qLxKDLYCitbrUiGHFx2WqeKpQcpQftUKpeSnCljbVtENK_PztSqjnxwOJA3A-3jWaF4bMc7tSslSE9_6qfDD95T0B2Xwlkk31c8_4KGoS6_WY_TerU67VW8P3U-3yucGNKqnickPVVDyfz1rMw Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:46:58.295837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2988ac4c59124e02bbcc7049e69dd599", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 71cbad05d1a54b4b9959e2ebbcb720fd Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.298868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': 'd400a3a2-9cc2-4ce5-959c-e45d459b58a9'} Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:58.300500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.303289 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.305961 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Returning 404 to user: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:58.305961 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fbb6ff38-dcfc-493e-8540-dfd695b7fe89 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 404 len: 111 microversion: 2.1 time: 0.038192 Jun 24 08:46:58.305961 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 387/775] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:46:58 2022] DELETE /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:46:58.316967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:58.318177 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: d400a3a2-9cc2-4ce5-959c-e45d459b58a9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:58.329928 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.330718 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.332117 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.332874 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.362175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] HTTP exception thrown: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Request method failure captured: Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 HTTP/1.1 Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiROebkf1QCea3YVodDpKh-is4p5qLxKDLYCitbrUiGHFx2WqeKpQcpQftUKpeSnCljbVtENK_PztSqjnxwOJA3A-3jWaF4bMc7tSslSE9_6qfDD95T0B2Xwlkk31c8_4KGoS6_WY_TerU67VW8P3U-3yucGNKqnickPVVDyfz1rMw Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:46:58.363937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2988ac4c59124e02bbcc7049e69dd599", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 71cbad05d1a54b4b9959e2ebbcb720fd Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.366872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'd400a3a2-9cc2-4ce5-959c-e45d459b58a9'} Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:58.368490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. Jun 24 08:46:58.371118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:58.373561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Returning 404 to user: Instance d400a3a2-9cc2-4ce5-959c-e45d459b58a9 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:58.373561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1842bf26-8b99-4183-9e62-c1046ed64cc4 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9" status: 404 len: 111 microversion: 2.1 time: 0.057944 Jun 24 08:46:58.373561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 389/776] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:58 2022] GET /compute/v2.1/servers/d400a3a2-9cc2-4ce5-959c-e45d459b58a9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:58.503696 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e067617a-2419-4240-a385-40644714abd7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:58.504991 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e067617a-2419-4240-a385-40644714abd7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:58.515111 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e067617a-2419-4240-a385-40644714abd7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.515821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e067617a-2419-4240-a385-40644714abd7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.517370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e067617a-2419-4240-a385-40644714abd7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.519605 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e067617a-2419-4240-a385-40644714abd7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.747425 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e067617a-2419-4240-a385-40644714abd7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:58.764753 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e067617a-2419-4240-a385-40644714abd7 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.266461 Jun 24 08:46:58.766110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 388/777] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:58 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:58.871278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:58.872180 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:58.884802 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.885756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.887466 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.888130 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.104460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:59.120596 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:59.125344 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:59.128022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6bd975dc-48b2-417a-aff7-715072c6b274 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.261225 Jun 24 08:46:59.129332 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 390/778] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:58 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:59.599852 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:59.600696 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:59.612886 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.613734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.615239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.616007 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.642780 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] HTTP exception thrown: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Request method failure captured: Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc HTTP/1.1 Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiROebkf1QCea3YVodDpKh-is4p5qLxKDLYCitbrUiGHFx2WqeKpQcpQftUKpeSnCljbVtENK_PztSqjnxwOJA3A-3jWaF4bMc7tSslSE9_6qfDD95T0B2Xwlkk31c8_4KGoS6_WY_TerU67VW8P3U-3yucGNKqnickPVVDyfz1rMw Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:46:59.644931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2988ac4c59124e02bbcc7049e69dd599", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 71cbad05d1a54b4b9959e2ebbcb720fd Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.647647 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '0d5d35ce-c7be-407a-a48d-ef65f3133dbc'} Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:59.649034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.651320 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.653546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Returning 404 to user: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:59.653546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c3d1474f-5f6c-423b-96bd-2b7cfe67ca6c tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 404 len: 111 microversion: 2.1 time: 0.055380 Jun 24 08:46:59.653546 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 389/779] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:46:59 2022] DELETE /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:59.659056 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:59.659870 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] [instance: 0d5d35ce-c7be-407a-a48d-ef65f3133dbc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:59.668017 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.668670 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.670424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.671243 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.699001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] HTTP exception thrown: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Request method failure captured: Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc HTTP/1.1 Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiROebkf1QCea3YVodDpKh-is4p5qLxKDLYCitbrUiGHFx2WqeKpQcpQftUKpeSnCljbVtENK_PztSqjnxwOJA3A-3jWaF4bMc7tSslSE9_6qfDD95T0B2Xwlkk31c8_4KGoS6_WY_TerU67VW8P3U-3yucGNKqnickPVVDyfz1rMw Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:46:59.702712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2988ac4c59124e02bbcc7049e69dd599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2988ac4c59124e02bbcc7049e69dd599", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 2988ac4c59124e02bbcc7049e69dd599 Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-285247819 Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 71cbad05d1a54b4b9959e2ebbcb720fd Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeTestJSON-285247819-project Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.705333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '0d5d35ce-c7be-407a-a48d-ef65f3133dbc'} Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:59.707616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. Jun 24 08:46:59.710489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:46:59.713361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] Returning 404 to user: Instance 0d5d35ce-c7be-407a-a48d-ef65f3133dbc could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:59.713361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cf489be6-d132-41c2-b0a1-587402e77f20 tempest-AttachVolumeTestJSON-285247819 tempest-AttachVolumeTestJSON-285247819-project] 10.222.0.13 "GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc" status: 404 len: 111 microversion: 2.1 time: 0.051806 Jun 24 08:46:59.713361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 391/780] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:59 2022] GET /compute/v2.1/servers/0d5d35ce-c7be-407a-a48d-ef65f3133dbc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:46:59.797026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f3f1cf94-1c54-4636-892c-8fa9450bb46d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:59.798366 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f3f1cf94-1c54-4636-892c-8fa9450bb46d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:59.816863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3f1cf94-1c54-4636-892c-8fa9450bb46d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.818895 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3f1cf94-1c54-4636-892c-8fa9450bb46d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.822635 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3f1cf94-1c54-4636-892c-8fa9450bb46d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.826733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3f1cf94-1c54-4636-892c-8fa9450bb46d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.162546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:00.165622 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:00.183997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:00.194230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.197424 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:00.199288 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.283135 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f3f1cf94-1c54-4636-892c-8fa9450bb46d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:00.292155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f3f1cf94-1c54-4636-892c-8fa9450bb46d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.503888 Jun 24 08:47:00.297543 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 390/781] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:59 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:00.731341 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:00.746536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:00.750736 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:00.753435 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f5fdd88c-7be7-4a78-b122-fd895adc0d6d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.599200 Jun 24 08:47:00.754827 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 392/782] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:00 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:01.345179 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-58eb8258-92b8-461a-9a29-7153273f1f07 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:01.351787 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-58eb8258-92b8-461a-9a29-7153273f1f07 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:01.371498 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58eb8258-92b8-461a-9a29-7153273f1f07 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.378307 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58eb8258-92b8-461a-9a29-7153273f1f07 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.380949 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58eb8258-92b8-461a-9a29-7153273f1f07 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.382134 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58eb8258-92b8-461a-9a29-7153273f1f07 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.757768 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-58eb8258-92b8-461a-9a29-7153273f1f07 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:01.773492 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-58eb8258-92b8-461a-9a29-7153273f1f07 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.442691 Jun 24 08:47:01.774836 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 391/783] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:01 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:01.793926 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:01.796757 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:01.814906 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.815865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.818715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.819774 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:02.743058 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:02.764370 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:02.768812 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:02.771622 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8461381b-d768-4e04-b7de-404c47062684 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.985228 Jun 24 08:47:02.773436 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 393/784] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:01 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:02.800807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-854643fd-35dd-4380-a079-e17fb36490cd tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:02.801667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-854643fd-35dd-4380-a079-e17fb36490cd tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:02.812937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-854643fd-35dd-4380-a079-e17fb36490cd tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:02.813755 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-854643fd-35dd-4380-a079-e17fb36490cd tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:02.815111 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-854643fd-35dd-4380-a079-e17fb36490cd tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:02.815820 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-854643fd-35dd-4380-a079-e17fb36490cd tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.161945 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-854643fd-35dd-4380-a079-e17fb36490cd tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:03.178709 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-854643fd-35dd-4380-a079-e17fb36490cd tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.383076 Jun 24 08:47:03.180669 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 392/785] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:02 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:03.803531 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:03.804305 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:03.812283 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.813049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.814026 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.814616 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.100005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:04.131049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:04.138850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:04.142215 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7faec4b1-fbf7-41ce-805b-f42bc15be2a9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.342614 Jun 24 08:47:04.157840 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 394/786] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:03 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:04.210656 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eb58720e-819a-4aa2-9adb-602d3489aeb5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:04.215142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eb58720e-819a-4aa2-9adb-602d3489aeb5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:04.229916 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb58720e-819a-4aa2-9adb-602d3489aeb5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:04.231034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb58720e-819a-4aa2-9adb-602d3489aeb5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.232950 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb58720e-819a-4aa2-9adb-602d3489aeb5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:04.233837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb58720e-819a-4aa2-9adb-602d3489aeb5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.610161 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eb58720e-819a-4aa2-9adb-602d3489aeb5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:04.637744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eb58720e-819a-4aa2-9adb-602d3489aeb5 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.434963 Jun 24 08:47:04.638839 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 393/787] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:04 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:04.687415 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-4a433b44-08ea-4978-96a3-c6e57c9c699e req-da08efe0-32f0-4dd4-bfc1-f3e64747bc8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345", "name": "network-vif-plugged", "status": "completed", "tag": "c876251e-542e-4240-b1d0-e6e3647c3f3c"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:04.699691 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-4a433b44-08ea-4978-96a3-c6e57c9c699e req-da08efe0-32f0-4dd4-bfc1-f3e64747bc8b service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:04.700244 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-4a433b44-08ea-4978-96a3-c6e57c9c699e req-da08efe0-32f0-4dd4-bfc1-f3e64747bc8b service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.724494 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-4a433b44-08ea-4978-96a3-c6e57c9c699e req-da08efe0-32f0-4dd4-bfc1-f3e64747bc8b service nova] Creating event network-vif-plugged:c876251e-542e-4240-b1d0-e6e3647c3f3c for instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 on hv-cinder-84713 Jun 24 08:47:04.740929 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-4a433b44-08ea-4978-96a3-c6e57c9c699e req-da08efe0-32f0-4dd4-bfc1-f3e64747bc8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399722 Jun 24 08:47:04.742059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 395/788] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:05.179811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:05.181928 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:05.199114 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.200026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.201933 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.202188 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.665064 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d3ccc20f-f6a9-4e02-b873-d02416fe80b9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:05.666762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d3ccc20f-f6a9-4e02-b873-d02416fe80b9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:05.684589 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3ccc20f-f6a9-4e02-b873-d02416fe80b9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.687086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3ccc20f-f6a9-4e02-b873-d02416fe80b9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.688821 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3ccc20f-f6a9-4e02-b873-d02416fe80b9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.689621 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3ccc20f-f6a9-4e02-b873-d02416fe80b9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.702981 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:05.725770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:05.729091 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:05.731572 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-097174b3-4fee-4144-9dda-2fb1e1107fc7 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.560843 Jun 24 08:47:05.733997 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 394/789] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:05 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:05.761015 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:05.984281 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d3ccc20f-f6a9-4e02-b873-d02416fe80b9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:06.008543 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d3ccc20f-f6a9-4e02-b873-d02416fe80b9 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1265 microversion: 2.1 time: 0.348190 Jun 24 08:47:06.009302 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 396/790] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:05 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:06.754070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:06.754986 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:06.762137 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.762790 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.763764 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.764270 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.041491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c9459572-74c9-480f-be69-85f016178e6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:07.043780 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c9459572-74c9-480f-be69-85f016178e6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:07.056252 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c9459572-74c9-480f-be69-85f016178e6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.059054 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c9459572-74c9-480f-be69-85f016178e6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.061604 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c9459572-74c9-480f-be69-85f016178e6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.062577 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c9459572-74c9-480f-be69-85f016178e6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.069834 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:07.131551 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:07.146272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:07.149363 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d3c6f9d8-9002-41ad-b6f5-fc2fbc4a8bc8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.400464 Jun 24 08:47:07.151547 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 395/791] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:06 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:07.333276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c9459572-74c9-480f-be69-85f016178e6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:07.344984 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c9459572-74c9-480f-be69-85f016178e6c tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1450 microversion: 2.1 time: 0.313323 Jun 24 08:47:07.346007 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 397/792] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:07 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1450 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:07.371787 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-72aec614-7f87-4f28-b259-19a9124dfe01 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:07.374103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-72aec614-7f87-4f28-b259-19a9124dfe01 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:07.385508 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72aec614-7f87-4f28-b259-19a9124dfe01 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.386313 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72aec614-7f87-4f28-b259-19a9124dfe01 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.387200 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72aec614-7f87-4f28-b259-19a9124dfe01 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.387643 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72aec614-7f87-4f28-b259-19a9124dfe01 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.670697 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-72aec614-7f87-4f28-b259-19a9124dfe01 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:07.693250 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-72aec614-7f87-4f28-b259-19a9124dfe01 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1450 microversion: 2.1 time: 0.332039 Jun 24 08:47:07.704070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 396/793] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:07 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1450 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:08.198882 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:08.200844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:08.230729 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:08.231929 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:08.234214 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:08.235003 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:08.587930 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:08.609330 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:08.614171 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:08.616756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-85d1c37b-0ae6-4983-98d5-fd833788d534 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.450006 Jun 24 08:47:08.618594 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 398/794] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:08 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:09.651721 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:09.652845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:09.678936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:09.680063 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:09.681724 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:09.686036 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:09.999787 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:10.026493 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:10.030166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:10.035134 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-70f6a6e7-12c3-4f3f-8ae3-6f4a4a6f9b8d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1742 microversion: 2.20 time: 0.390365 Jun 24 08:47:10.054043 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 397/795] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:09 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1742 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:11.069775 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:11.070438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:11.087736 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.096171 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.099151 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.100006 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.367195 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:11.377456 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:11.381490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:11.392042 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-06b0f5c9-4c44-4602-ae9f-f6d7733ad4b0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1742 microversion: 2.20 time: 0.326665 Jun 24 08:47:11.394521 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 399/796] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:11 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1742 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:11.406540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-30f28766-784a-4d4e-9e48-861078f43b22 req-bf88ff26-86b2-4a61-8f92-33865e795368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345", "tag": "c876251e-542e-4240-b1d0-e6e3647c3f3c"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:11.435818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-30f28766-784a-4d4e-9e48-861078f43b22 req-bf88ff26-86b2-4a61-8f92-33865e795368 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.437351 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-30f28766-784a-4d4e-9e48-861078f43b22 req-bf88ff26-86b2-4a61-8f92-33865e795368 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.453258 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:11.493412 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-30f28766-784a-4d4e-9e48-861078f43b22 req-bf88ff26-86b2-4a61-8f92-33865e795368 service nova] Creating event network-changed:c876251e-542e-4240-b1d0-e6e3647c3f3c for instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 on hv-cinder-84713 Jun 24 08:47:11.526304 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-30f28766-784a-4d4e-9e48-861078f43b22 req-bf88ff26-86b2-4a61-8f92-33865e795368 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122756 Jun 24 08:47:11.530133 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 398/797] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:12.425463 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:12.426873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:12.438968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:12.439492 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:12.440316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:12.440753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:13.255170 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:13.265317 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:13.267483 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:13.268997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-674ea502-92a2-4d39-af40-e03e42b0f78b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.848575 Jun 24 08:47:13.271753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 400/798] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:12 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:14.328905 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:14.337865 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:14.393868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.398602 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.399740 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.400873 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.468482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-63ded1b5-99f3-4396-ac75-2877b517c3c4 req-df2bb842-c6e1-4b0c-b7a3-c1e9269ba8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268", "name": "network-vif-plugged", "status": "completed", "tag": "43c59752-b640-4bc3-91df-788def083aa2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:14.504014 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-63ded1b5-99f3-4396-ac75-2877b517c3c4 req-df2bb842-c6e1-4b0c-b7a3-c1e9269ba8be service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.508186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-63ded1b5-99f3-4396-ac75-2877b517c3c4 req-df2bb842-c6e1-4b0c-b7a3-c1e9269ba8be service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.605123 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-63ded1b5-99f3-4396-ac75-2877b517c3c4 req-df2bb842-c6e1-4b0c-b7a3-c1e9269ba8be service nova] Creating event network-vif-plugged:43c59752-b640-4bc3-91df-788def083aa2 for instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 on hv-cinder-84713 Jun 24 08:47:14.627325 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-63ded1b5-99f3-4396-ac75-2877b517c3c4 req-df2bb842-c6e1-4b0c-b7a3-c1e9269ba8be service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162785 Jun 24 08:47:14.632880 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 401/799] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:14.861764 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:14.874597 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:14.877628 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:14.879901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0eb22ea4-6312-4d97-b9f6-8dbaa0db954f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.566277 Jun 24 08:47:14.881555 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 399/800] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:14 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:15.031534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b22ab814-a46d-4562-9537-9b1c67305b0c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: .version_select at 0x7f0a6ff713a0>, body: {"keypair": {"name": "tempest-keypair-1764160074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYyoASwja5NV/7O1y0wUr5znGLO6RHo2fN8f5Ng89dm4yumiy1qYTEyatEZxxCBd+IDEPOFKbPMfPYtZqSIAhdh9kbDJmhMo3XCI/wog39Ar113j5EjEHeAtgi1sckxfw=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:15.052975 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-b22ab814-a46d-4562-9537-9b1c67305b0c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for project 7787ee132e9e4e23b1407718fb366406. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:47:15.063782 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-b22ab814-a46d-4562-9537-9b1c67305b0c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for user 8d15a76041274e7381087bd21eb674c9 and project 7787ee132e9e4e23b1407718fb366406. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:47:15.099707 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b22ab814-a46d-4562-9537-9b1c67305b0c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.291748 Jun 24 08:47:15.101185 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 402/801] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:47:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:15.903463 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:15.907271 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:15.923194 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:15.925621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:15.927766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:15.928929 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.231021 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:16.264607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:16.266327 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:16.267584 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0deccc05-20f7-4748-b677-3897a9faf7b1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.371719 Jun 24 08:47:16.268517 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 400/802] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:15 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:17.290557 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:17.291809 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:17.321664 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.327379 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.329335 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.331776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.667115 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:17.681098 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:17.688824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:17.692063 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-42f0e8c1-4e57-4ef1-abeb-f2b0d8c0c026 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.408963 Jun 24 08:47:17.698846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 403/803] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:17 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:17.966752 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-427461470", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f76c266-a8af-466b-8b61-0e931014df30"}], "security_groups": [{"name": "tempest-securitygroup--1722919417"}], "key_name": "tempest-keypair-1764160074", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:18.221551 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] validate_networks() for [('0f76c266-a8af-466b-8b61-0e931014df30', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:47:18.734685 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:18.735486 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:18.757123 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:18.759468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:18.761556 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:18.764763 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:19.031843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:19.045721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:19.049597 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:19.051170 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bf67779b-4f5b-435b-9f36-9c79759f3d0a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.325627 Jun 24 08:47:19.066981 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 404/804] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:18 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:19.349306 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:47:19.350428 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:47:19.351041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:47:19.351520 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:47:19.352021 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:47:19.370653 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:19.371366 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:19.372898 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:19.373402 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:19.394812 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for project 7787ee132e9e4e23b1407718fb366406. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:47:19.399624 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for user 8d15a76041274e7381087bd21eb674c9 and project 7787ee132e9e4e23b1407718fb366406. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:47:19.420280 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:47:19.422854 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:47:19.504477 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dfe9d6f2-2438-4a65-949a-7978ea7c1ab1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.542870 Jun 24 08:47:19.505469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 401/805] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:47:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:47:19.523967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cdccce2c-81cf-4e47-a605-e70274decb69 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:19.525355 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cdccce2c-81cf-4e47-a605-e70274decb69 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:19.646652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cdccce2c-81cf-4e47-a605-e70274decb69 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:19.663297 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cdccce2c-81cf-4e47-a605-e70274decb69 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1241 microversion: 2.1 time: 0.146500 Jun 24 08:47:19.666489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 405/806] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:19 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:20.074800 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:20.075891 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:20.100506 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.101553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.103088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.104018 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.476547 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:20.486650 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:20.491202 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:20.492573 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-79f280c3-dab9-4fb8-b969-013f0e5c9cd8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.424731 Jun 24 08:47:20.493771 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 402/807] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:20 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:20.695485 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ba3bb407-7ebe-4a05-9838-4a7e3dc021d2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:20.696615 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ba3bb407-7ebe-4a05-9838-4a7e3dc021d2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:20.719186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba3bb407-7ebe-4a05-9838-4a7e3dc021d2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.719428 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba3bb407-7ebe-4a05-9838-4a7e3dc021d2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.720660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba3bb407-7ebe-4a05-9838-4a7e3dc021d2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.721296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba3bb407-7ebe-4a05-9838-4a7e3dc021d2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.829245 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ba3bb407-7ebe-4a05-9838-4a7e3dc021d2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:20.846781 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ba3bb407-7ebe-4a05-9838-4a7e3dc021d2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1245 microversion: 2.1 time: 0.157811 Jun 24 08:47:20.848876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 406/808] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:20 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1245 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:21.533319 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:21.534533 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:21.548175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.549795 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.551538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.552441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.823324 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:21.843581 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:21.845986 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:21.847544 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8c262927-62f8-4bdf-b675-663d62f8d5df tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.322113 Jun 24 08:47:21.848654 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 403/809] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:21 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:21.865614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ace30ff0-83b0-43c0-b2e2-bca42d94a5c5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:21.867099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ace30ff0-83b0-43c0-b2e2-bca42d94a5c5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:21.886491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ace30ff0-83b0-43c0-b2e2-bca42d94a5c5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.887268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ace30ff0-83b0-43c0-b2e2-bca42d94a5c5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.889152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ace30ff0-83b0-43c0-b2e2-bca42d94a5c5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.890015 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ace30ff0-83b0-43c0-b2e2-bca42d94a5c5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:22.019665 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ace30ff0-83b0-43c0-b2e2-bca42d94a5c5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:22.032961 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ace30ff0-83b0-43c0-b2e2-bca42d94a5c5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1245 microversion: 2.1 time: 0.171273 Jun 24 08:47:22.033739 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 407/810] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:21 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1245 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:22.880863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:22.881817 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:22.907758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:22.908555 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:22.915638 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:22.916630 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.061109 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cc02d3b1-3a55-4ca3-803e-925b582ce51b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:23.062171 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cc02d3b1-3a55-4ca3-803e-925b582ce51b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:23.073143 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cc02d3b1-3a55-4ca3-803e-925b582ce51b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.073879 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cc02d3b1-3a55-4ca3-803e-925b582ce51b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.075048 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cc02d3b1-3a55-4ca3-803e-925b582ce51b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.076268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cc02d3b1-3a55-4ca3-803e-925b582ce51b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.195165 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cc02d3b1-3a55-4ca3-803e-925b582ce51b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.220772 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cc02d3b1-3a55-4ca3-803e-925b582ce51b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1299 microversion: 2.1 time: 0.166281 Jun 24 08:47:23.222593 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 408/811] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:23 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:23.329452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.345055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.348956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.364405 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2773377a-f3df-45cd-9017-b740e8f14643 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.488282 Jun 24 08:47:23.365825 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 404/812] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:22 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:24.239925 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-56f0aed4-8332-4417-a5b8-4f0a16be9eb2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:24.241209 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-56f0aed4-8332-4417-a5b8-4f0a16be9eb2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:24.249278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:24.251857 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56f0aed4-8332-4417-a5b8-4f0a16be9eb2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.252191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56f0aed4-8332-4417-a5b8-4f0a16be9eb2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.253537 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56f0aed4-8332-4417-a5b8-4f0a16be9eb2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.254202 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56f0aed4-8332-4417-a5b8-4f0a16be9eb2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.393382 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:24.395761 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:24.400956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:24.427496 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.428284 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.429912 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.430745 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.797001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-56f0aed4-8332-4417-a5b8-4f0a16be9eb2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:24.813337 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-56f0aed4-8332-4417-a5b8-4f0a16be9eb2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.576827 Jun 24 08:47:24.814844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 409/813] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:24 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:24.824894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:24.841758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:24.845897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:24.848417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-64b49ddb-b80f-4dbf-80eb-e696cd4b8e17 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.464675 Jun 24 08:47:24.850288 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 405/814] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:24 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:25.841280 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bd95be1e-3f32-4a98-a6a6-2effc561550d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:25.843014 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bd95be1e-3f32-4a98-a6a6-2effc561550d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:25.852607 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd95be1e-3f32-4a98-a6a6-2effc561550d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.853252 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd95be1e-3f32-4a98-a6a6-2effc561550d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.854477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd95be1e-3f32-4a98-a6a6-2effc561550d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.855067 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd95be1e-3f32-4a98-a6a6-2effc561550d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.877979 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:25.879686 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:25.887557 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.889174 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.890424 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.891100 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:26.243652 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:26.256547 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bd95be1e-3f32-4a98-a6a6-2effc561550d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:26.266667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:26.269939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:26.270885 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bd95be1e-3f32-4a98-a6a6-2effc561550d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.434906 Jun 24 08:47:26.281900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-08f32eb2-5543-4995-84cb-e3e462afe8c0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.400051 Jun 24 08:47:26.281900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 406/815] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:25 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:26.288484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 410/816] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:25 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:27.292793 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-323392f4-8af2-45b9-8800-8a86d46195bd tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:27.295280 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-323392f4-8af2-45b9-8800-8a86d46195bd tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:27.308031 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:27.314915 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:27.318015 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-323392f4-8af2-45b9-8800-8a86d46195bd tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.318915 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-323392f4-8af2-45b9-8800-8a86d46195bd tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.320352 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-323392f4-8af2-45b9-8800-8a86d46195bd tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.321198 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-323392f4-8af2-45b9-8800-8a86d46195bd tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.327678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.328374 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.330141 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.331050 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.738759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-323392f4-8af2-45b9-8800-8a86d46195bd tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.755732 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-323392f4-8af2-45b9-8800-8a86d46195bd tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.467124 Jun 24 08:47:27.765802 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 407/817] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:27 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:27.775323 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.793532 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.797210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.799430 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5261f6ff-0563-4ccf-bfae-2d65a042009f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1737 microversion: 2.20 time: 0.498318 Jun 24 08:47:27.805678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 411/818] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:27 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1737 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:28.253056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-20298b2b-e8f0-42c2-86d4-4ed201fdd68c req-b897edf2-8581-4505-918d-f2495c0bc060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57397a13-99c7-451e-8c0a-a7c6303a7fa9", "tag": "9c96470b-899f-45c4-b463-69a3cf1070d2"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:28.269565 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-20298b2b-e8f0-42c2-86d4-4ed201fdd68c req-b897edf2-8581-4505-918d-f2495c0bc060 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.270373 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-20298b2b-e8f0-42c2-86d4-4ed201fdd68c req-b897edf2-8581-4505-918d-f2495c0bc060 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.293519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-20298b2b-e8f0-42c2-86d4-4ed201fdd68c req-b897edf2-8581-4505-918d-f2495c0bc060 service nova] Creating event network-changed:9c96470b-899f-45c4-b463-69a3cf1070d2 for instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 on hv-cinder-84713 Jun 24 08:47:28.301323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-20298b2b-e8f0-42c2-86d4-4ed201fdd68c req-b897edf2-8581-4505-918d-f2495c0bc060 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055977 Jun 24 08:47:28.302330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 408/819] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:28.782487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c51ee967-e8e7-4fb2-aca7-29e4cbdeca09 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:28.783445 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c51ee967-e8e7-4fb2-aca7-29e4cbdeca09 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:28.791983 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c51ee967-e8e7-4fb2-aca7-29e4cbdeca09 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.792578 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c51ee967-e8e7-4fb2-aca7-29e4cbdeca09 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.793748 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c51ee967-e8e7-4fb2-aca7-29e4cbdeca09 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.799118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c51ee967-e8e7-4fb2-aca7-29e4cbdeca09 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.831681 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:28.832139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:28.838989 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.839367 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.840356 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.841607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.382642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:29.416235 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:29.522072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c51ee967-e8e7-4fb2-aca7-29e4cbdeca09 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:29.533099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c51ee967-e8e7-4fb2-aca7-29e4cbdeca09 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.755977 Jun 24 08:47:29.533964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 412/820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:28 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:29.580874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:29.590354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:29.592572 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:29.593882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c3edda89-d7ce-4dc4-a6a6-385cc8615cf6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1719 microversion: 2.20 time: 0.769120 Jun 24 08:47:29.594460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 409/821] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:28 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1719 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:30.550833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aa9c8888-4d39-4d8d-b67d-453fd4ee4bf2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:30.552698 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-aa9c8888-4d39-4d8d-b67d-453fd4ee4bf2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:30.553807 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:30.561095 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa9c8888-4d39-4d8d-b67d-453fd4ee4bf2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.561682 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa9c8888-4d39-4d8d-b67d-453fd4ee4bf2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.562559 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa9c8888-4d39-4d8d-b67d-453fd4ee4bf2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.563173 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa9c8888-4d39-4d8d-b67d-453fd4ee4bf2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.615091 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:30.616236 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:30.629161 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.629983 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.631358 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.632145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.865793 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aa9c8888-4d39-4d8d-b67d-453fd4ee4bf2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:30.874205 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aa9c8888-4d39-4d8d-b67d-453fd4ee4bf2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.327457 Jun 24 08:47:30.874895 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 413/822] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:30 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:30.914992 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:30.924672 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:30.926408 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:30.927704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b4d22893-1a2e-4248-865c-c7039c62db39 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1719 microversion: 2.20 time: 0.318540 Jun 24 08:47:30.928358 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 410/823] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:30 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1719 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:31.892557 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7c3155fe-baa9-482f-bde8-1757bd1589da tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:31.893534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7c3155fe-baa9-482f-bde8-1757bd1589da tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:31.900576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c3155fe-baa9-482f-bde8-1757bd1589da tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.901021 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c3155fe-baa9-482f-bde8-1757bd1589da tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.901841 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c3155fe-baa9-482f-bde8-1757bd1589da tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.902276 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c3155fe-baa9-482f-bde8-1757bd1589da tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.949465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:31.951020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:31.959047 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.959620 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.960557 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.961106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:32.143283 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7c3155fe-baa9-482f-bde8-1757bd1589da tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:32.151058 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7c3155fe-baa9-482f-bde8-1757bd1589da tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.263059 Jun 24 08:47:32.152016 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 414/824] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:31 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:32.175032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:32.183506 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:32.186103 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:32.186839 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0a38c8f0-9f25-4ec9-b871-675424c2127b tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1719 microversion: 2.20 time: 0.241939 Jun 24 08:47:32.187648 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 411/825] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:31 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:33.006941 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-303c94fe-da1a-4703-af48-b4c3133515c1 req-814be186-9392-4202-a29d-97d39a963610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268", "name": "network-vif-unplugged", "status": "completed", "tag": "43c59752-b640-4bc3-91df-788def083aa2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:33.018791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-303c94fe-da1a-4703-af48-b4c3133515c1 req-814be186-9392-4202-a29d-97d39a963610 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.019679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-303c94fe-da1a-4703-af48-b4c3133515c1 req-814be186-9392-4202-a29d-97d39a963610 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.036443 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-303c94fe-da1a-4703-af48-b4c3133515c1 req-814be186-9392-4202-a29d-97d39a963610 service nova] Creating event network-vif-unplugged:43c59752-b640-4bc3-91df-788def083aa2 for instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 on hv-cinder-84713 Jun 24 08:47:33.043110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-303c94fe-da1a-4703-af48-b4c3133515c1 req-814be186-9392-4202-a29d-97d39a963610 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039746 Jun 24 08:47:33.044724 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 415/826] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:33.174889 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7e20b474-1b77-4b74-b43d-4418930bdaeb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:33.175496 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7e20b474-1b77-4b74-b43d-4418930bdaeb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:33.182850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e20b474-1b77-4b74-b43d-4418930bdaeb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.183295 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e20b474-1b77-4b74-b43d-4418930bdaeb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.184057 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e20b474-1b77-4b74-b43d-4418930bdaeb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.184489 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e20b474-1b77-4b74-b43d-4418930bdaeb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.205609 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:33.206316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:33.213030 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.213514 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.214305 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.214748 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.219860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:33.405354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7e20b474-1b77-4b74-b43d-4418930bdaeb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:33.409669 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:33.413003 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7e20b474-1b77-4b74-b43d-4418930bdaeb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.241929 Jun 24 08:47:33.414059 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 412/827] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:33 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:33.418978 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:33.421089 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:33.422365 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c815763b-6141-4f85-8f0d-a2f16305fcfa tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1719 microversion: 2.20 time: 0.220971 Jun 24 08:47:33.422947 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 416/828] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:33 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:34.431324 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7a05e0f3-3a70-4dfc-91b6-5195eb6a4d5f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:34.432065 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7a05e0f3-3a70-4dfc-91b6-5195eb6a4d5f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:34.440162 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a05e0f3-3a70-4dfc-91b6-5195eb6a4d5f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.440601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a05e0f3-3a70-4dfc-91b6-5195eb6a4d5f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.441316 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:34.442443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a05e0f3-3a70-4dfc-91b6-5195eb6a4d5f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.442443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a05e0f3-3a70-4dfc-91b6-5195eb6a4d5f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.442656 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:34.450815 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.451410 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.452208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.452647 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.664797 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7a05e0f3-3a70-4dfc-91b6-5195eb6a4d5f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:34.668226 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:34.673299 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7a05e0f3-3a70-4dfc-91b6-5195eb6a4d5f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.246268 Jun 24 08:47:34.674019 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 413/829] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:34 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:34.680226 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:34.681745 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:34.682904 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-92dbbc46-722e-4f5f-9110-e22560775200 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1722 microversion: 2.20 time: 0.246128 Jun 24 08:47:34.683454 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 417/830] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:34 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:34.701991 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-32ded46c-57d8-44ee-a634-ba18420b1987 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4d98877-1931-49f6-a99e-1a12df6ac260"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:34.703064 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-32ded46c-57d8-44ee-a634-ba18420b1987 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:34.709670 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32ded46c-57d8-44ee-a634-ba18420b1987 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.710145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32ded46c-57d8-44ee-a634-ba18420b1987 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.710914 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32ded46c-57d8-44ee-a634-ba18420b1987 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.711346 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32ded46c-57d8-44ee-a634-ba18420b1987 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.161404 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:35.181614 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-32ded46c-57d8-44ee-a634-ba18420b1987 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.484377 Jun 24 08:47:35.182288 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 414/831] 10.222.0.13 () {62 vars in 1363 bytes} [Fri Jun 24 08:47:34 2022] POST /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/os-volume_attachments => generated 188 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:47:35.321919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ecd3bdc5-476d-4d0e-a5c8-f5c976bf7b96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:35.321919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ecd3bdc5-476d-4d0e-a5c8-f5c976bf7b96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.332160 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ecd3bdc5-476d-4d0e-a5c8-f5c976bf7b96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.333097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ecd3bdc5-476d-4d0e-a5c8-f5c976bf7b96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.334852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ecd3bdc5-476d-4d0e-a5c8-f5c976bf7b96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.335741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ecd3bdc5-476d-4d0e-a5c8-f5c976bf7b96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.699594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-520e1176-5c52-458e-aaa1-4d99669cc76b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:35.703389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-520e1176-5c52-458e-aaa1-4d99669cc76b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.723985 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-520e1176-5c52-458e-aaa1-4d99669cc76b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.725442 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-520e1176-5c52-458e-aaa1-4d99669cc76b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.726842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-520e1176-5c52-458e-aaa1-4d99669cc76b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.727880 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-520e1176-5c52-458e-aaa1-4d99669cc76b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.729099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ecd3bdc5-476d-4d0e-a5c8-f5c976bf7b96 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/os-volume_attachments/d4d98877-1931-49f6-a99e-1a12df6ac260" status: 202 len: 0 microversion: 2.20 time: 0.419478 Jun 24 08:47:35.730259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 418/832] 10.222.0.13 () {60 vars in 1456 bytes} [Fri Jun 24 08:47:35 2022] DELETE /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/os-volume_attachments/d4d98877-1931-49f6-a99e-1a12df6ac260 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:47:35.821846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4a3781fc-bb6c-4771-9cbb-c4a70a0673a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:35.823000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4a3781fc-bb6c-4771-9cbb-c4a70a0673a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.832410 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a3781fc-bb6c-4771-9cbb-c4a70a0673a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.833241 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a3781fc-bb6c-4771-9cbb-c4a70a0673a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.834625 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a3781fc-bb6c-4771-9cbb-c4a70a0673a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.835939 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a3781fc-bb6c-4771-9cbb-c4a70a0673a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.963172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-520e1176-5c52-458e-aaa1-4d99669cc76b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:35.973481 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-520e1176-5c52-458e-aaa1-4d99669cc76b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.284512 Jun 24 08:47:35.974308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 415/833] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:35 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:35.994484 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4a3781fc-bb6c-4771-9cbb-c4a70a0673a6 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "POST /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/action" status: 202 len: 0 microversion: 2.20 time: 0.180920 Jun 24 08:47:35.995461 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 419/834] 10.222.0.13 () {62 vars in 1318 bytes} [Fri Jun 24 08:47:35 2022] POST /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:47:36.004236 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:36.004838 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:36.010917 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:36.011357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:36.012160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:36.012946 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:36.177115 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:36.190607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:36.192969 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:36.194983 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a59a5450-5d3b-47c4-acc6-c689d1031d90 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1670 microversion: 2.20 time: 0.194655 Jun 24 08:47:36.195923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 416/835] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:35 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:36.995985 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5cfe5482-313f-4bb2-9e52-5621e4dd7158 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:36.997082 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5cfe5482-313f-4bb2-9e52-5621e4dd7158 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:37.011220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5cfe5482-313f-4bb2-9e52-5621e4dd7158 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.011851 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5cfe5482-313f-4bb2-9e52-5621e4dd7158 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.013718 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5cfe5482-313f-4bb2-9e52-5621e4dd7158 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.014492 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5cfe5482-313f-4bb2-9e52-5621e4dd7158 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.164085 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5cfe5482-313f-4bb2-9e52-5621e4dd7158 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:37.173062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5cfe5482-313f-4bb2-9e52-5621e4dd7158 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.182432 Jun 24 08:47:37.173651 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 420/836] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:36 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:37.220976 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:37.221567 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:37.228674 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.229108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.229920 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.230345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.375363 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:37.384134 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:37.385621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:37.386832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-96e6e784-a8b5-4327-b364-25c8a69286f9 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1670 microversion: 2.20 time: 0.170480 Jun 24 08:47:37.387597 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 417/837] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:37 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:38.194842 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-73162b67-4171-43ba-ac69-8759406b5f8a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:38.195888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-73162b67-4171-43ba-ac69-8759406b5f8a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:38.207666 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73162b67-4171-43ba-ac69-8759406b5f8a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.208405 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73162b67-4171-43ba-ac69-8759406b5f8a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.209771 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73162b67-4171-43ba-ac69-8759406b5f8a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.210491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73162b67-4171-43ba-ac69-8759406b5f8a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.377519 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-73162b67-4171-43ba-ac69-8759406b5f8a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:38.386091 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-73162b67-4171-43ba-ac69-8759406b5f8a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.198058 Jun 24 08:47:38.386769 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 421/838] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:38 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:38.406293 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:38.406952 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:38.414150 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.414602 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.415403 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.415845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.575207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:38.583924 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:38.585420 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:38.586653 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a116ab45-9985-4aee-ab4a-e7435a8e04fb tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1670 microversion: 2.20 time: 0.184802 Jun 24 08:47:38.587219 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 418/839] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:38 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:39.409061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1d773000-44da-499a-94e1-21fc20a5e6d5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:39.410391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1d773000-44da-499a-94e1-21fc20a5e6d5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:39.423200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d773000-44da-499a-94e1-21fc20a5e6d5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.423982 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d773000-44da-499a-94e1-21fc20a5e6d5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.425353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d773000-44da-499a-94e1-21fc20a5e6d5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.426163 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d773000-44da-499a-94e1-21fc20a5e6d5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.607757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:39.608679 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:39.617079 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.617714 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.618663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.619201 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.730453 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1d773000-44da-499a-94e1-21fc20a5e6d5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:39.742114 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1d773000-44da-499a-94e1-21fc20a5e6d5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.341074 Jun 24 08:47:39.742957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 422/840] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:39 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:39.865306 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:39.876446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:39.878715 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:39.880153 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cee44d1a-3f70-4940-8f08-524cc1542696 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.277471 Jun 24 08:47:39.881150 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 419/841] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:39 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:40.783929 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b6fc08e7-00e0-4855-8363-efa2dd88f079 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:40.787646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b6fc08e7-00e0-4855-8363-efa2dd88f079 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:40.812615 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b6fc08e7-00e0-4855-8363-efa2dd88f079 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.813716 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b6fc08e7-00e0-4855-8363-efa2dd88f079 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.816548 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b6fc08e7-00e0-4855-8363-efa2dd88f079 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.817817 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b6fc08e7-00e0-4855-8363-efa2dd88f079 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.905366 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:40.906233 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:40.935367 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.935829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.936698 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.938481 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:41.254803 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b6fc08e7-00e0-4855-8363-efa2dd88f079 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:41.281107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b6fc08e7-00e0-4855-8363-efa2dd88f079 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.508118 Jun 24 08:47:41.282471 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 423/842] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:40 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:41.291805 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-18415d29-e16b-4278-8298-ab7164be3831 req-4e38b689-ade1-4258-8ba5-5350214b9059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57397a13-99c7-451e-8c0a-a7c6303a7fa9", "name": "network-vif-plugged", "status": "completed", "tag": "9c96470b-899f-45c4-b463-69a3cf1070d2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:41.324739 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-18415d29-e16b-4278-8298-ab7164be3831 req-4e38b689-ade1-4258-8ba5-5350214b9059 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:41.326107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-18415d29-e16b-4278-8298-ab7164be3831 req-4e38b689-ade1-4258-8ba5-5350214b9059 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:41.351201 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-18415d29-e16b-4278-8298-ab7164be3831 req-4e38b689-ade1-4258-8ba5-5350214b9059 service nova] Creating event network-vif-plugged:9c96470b-899f-45c4-b463-69a3cf1070d2 for instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 on hv-cinder-84713 Jun 24 08:47:41.376287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-18415d29-e16b-4278-8298-ab7164be3831 req-4e38b689-ade1-4258-8ba5-5350214b9059 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090544 Jun 24 08:47:41.381796 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 424/843] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:41.440771 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:41.458681 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:41.465020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:41.470380 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a23b6e08-0b98-42c8-945b-0b9c41c084ea tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.571201 Jun 24 08:47:41.473534 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 420/844] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:40 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:42.302768 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-69d38154-2134-4793-b6fc-af59140be202 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:42.303765 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-69d38154-2134-4793-b6fc-af59140be202 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:42.311070 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69d38154-2134-4793-b6fc-af59140be202 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.311822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69d38154-2134-4793-b6fc-af59140be202 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.312619 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69d38154-2134-4793-b6fc-af59140be202 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.313057 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69d38154-2134-4793-b6fc-af59140be202 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.498121 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-69d38154-2134-4793-b6fc-af59140be202 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.499599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:42.500219 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:42.507462 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-69d38154-2134-4793-b6fc-af59140be202 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.210348 Jun 24 08:47:42.507707 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.507959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.509007 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 425/845] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:42 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:42.514349 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.515232 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.679502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.693608 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.697624 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.701210 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ae967c43-d776-4d5f-8d02-40417cac1261 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.204993 Jun 24 08:47:42.702731 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 421/846] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:42 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:43.530239 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dc59b297-a0e9-4952-a588-5024fa4b2905 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:43.531758 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dc59b297-a0e9-4952-a588-5024fa4b2905 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:43.542407 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dc59b297-a0e9-4952-a588-5024fa4b2905 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.543022 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dc59b297-a0e9-4952-a588-5024fa4b2905 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.544963 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dc59b297-a0e9-4952-a588-5024fa4b2905 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.545554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dc59b297-a0e9-4952-a588-5024fa4b2905 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.705432 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dc59b297-a0e9-4952-a588-5024fa4b2905 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:43.722335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:43.723586 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:43.726064 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dc59b297-a0e9-4952-a588-5024fa4b2905 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.202585 Jun 24 08:47:43.727249 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 426/847] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:43 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:43.731711 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.732428 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.733374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.734228 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.895897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:43.905795 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:43.908054 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:43.909515 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3d20dd52-361f-45f6-aa9d-92df1c078d36 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.191195 Jun 24 08:47:43.910692 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 422/848] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:43 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:44.753683 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-56627cdd-8d76-4f46-b81f-d131795c0e59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:44.754552 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-56627cdd-8d76-4f46-b81f-d131795c0e59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:44.772186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56627cdd-8d76-4f46-b81f-d131795c0e59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.773031 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56627cdd-8d76-4f46-b81f-d131795c0e59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.774413 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56627cdd-8d76-4f46-b81f-d131795c0e59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.775109 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56627cdd-8d76-4f46-b81f-d131795c0e59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.941380 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:44.944422 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:44.971272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.972565 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.974847 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.976000 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.002353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-56627cdd-8d76-4f46-b81f-d131795c0e59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:45.014737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-56627cdd-8d76-4f46-b81f-d131795c0e59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.265310 Jun 24 08:47:45.027551 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 427/849] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:44 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:45.259765 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:45.270047 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:45.272161 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:45.274001 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fcef72d7-d030-4474-bb85-5374e9aaeec2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.348538 Jun 24 08:47:45.275116 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 423/850] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:44 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:46.046815 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1e1f5f3f-320b-4786-aca6-593b9c717f12 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:46.048072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1e1f5f3f-320b-4786-aca6-593b9c717f12 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:46.055806 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f3f-320b-4786-aca6-593b9c717f12 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.056248 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f3f-320b-4786-aca6-593b9c717f12 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.057074 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f3f-320b-4786-aca6-593b9c717f12 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.057666 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f3f-320b-4786-aca6-593b9c717f12 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.260754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1e1f5f3f-320b-4786-aca6-593b9c717f12 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:46.280798 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1e1f5f3f-320b-4786-aca6-593b9c717f12 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.239359 Jun 24 08:47:46.283435 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 428/851] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:46 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:46.304300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:46.305530 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:46.320422 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.321521 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.322706 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.323453 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.693936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:46.712309 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:46.720933 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:46.724612 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5efec50f-05e3-4847-827e-0b8c02deed92 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.427156 Jun 24 08:47:46.726212 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 424/852] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:46 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:47.308461 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a89c94f7-511d-477c-a429-529751017a66 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:47.310357 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a89c94f7-511d-477c-a429-529751017a66 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:47.324496 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a89c94f7-511d-477c-a429-529751017a66 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.325678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a89c94f7-511d-477c-a429-529751017a66 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.326555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a89c94f7-511d-477c-a429-529751017a66 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.326991 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a89c94f7-511d-477c-a429-529751017a66 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.541849 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a89c94f7-511d-477c-a429-529751017a66 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:47.560762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a89c94f7-511d-477c-a429-529751017a66 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.253104 Jun 24 08:47:47.562261 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 429/853] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:47 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:47.743692 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:47.745056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:47.754051 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.754851 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.755907 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.756570 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.965418 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:47.995196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:47.998811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:48.003597 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-41dc5c8d-8ad9-4e22-afb8-fee3c9a95426 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.263940 Jun 24 08:47:48.014512 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 425/854] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:47 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:48.580361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-143dd64f-9cb5-451f-9c2d-19a6f9b4d230 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:48.581387 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-143dd64f-9cb5-451f-9c2d-19a6f9b4d230 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:48.590301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-143dd64f-9cb5-451f-9c2d-19a6f9b4d230 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:48.591098 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-143dd64f-9cb5-451f-9c2d-19a6f9b4d230 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:48.592886 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-143dd64f-9cb5-451f-9c2d-19a6f9b4d230 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:48.593633 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-143dd64f-9cb5-451f-9c2d-19a6f9b4d230 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:48.598198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:48.806601 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-143dd64f-9cb5-451f-9c2d-19a6f9b4d230 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:48.817266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-143dd64f-9cb5-451f-9c2d-19a6f9b4d230 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.242363 Jun 24 08:47:48.818092 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 430/855] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:48 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:49.023948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:49.025166 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:49.036737 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.037236 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.038112 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.038645 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.245175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:49.281652 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:49.285368 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:49.288191 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-33802904-37a8-4a71-9018-2d48299db6ae tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.268299 Jun 24 08:47:49.289868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 426/856] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:49 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:49.837252 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1b58fdaa-0e8d-4da5-a86d-cb762b8ee0dc tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:49.837868 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1b58fdaa-0e8d-4da5-a86d-cb762b8ee0dc tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:49.844702 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b58fdaa-0e8d-4da5-a86d-cb762b8ee0dc tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.845143 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b58fdaa-0e8d-4da5-a86d-cb762b8ee0dc tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.846059 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b58fdaa-0e8d-4da5-a86d-cb762b8ee0dc tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.846501 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b58fdaa-0e8d-4da5-a86d-cb762b8ee0dc tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.094626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b58fdaa-0e8d-4da5-a86d-cb762b8ee0dc tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:50.103166 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1b58fdaa-0e8d-4da5-a86d-cb762b8ee0dc tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.269758 Jun 24 08:47:50.113231 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 431/857] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:49 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:50.318379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:50.319022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:50.326700 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.327146 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.327936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.328375 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.482273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:50.492206 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:50.493734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:50.494938 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b14b07e4-802d-43e8-9b0d-155c673c37f1 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.180830 Jun 24 08:47:50.495502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 427/858] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:50 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:51.120527 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-638319a7-e999-4e08-93e9-8e7543c6aa46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:51.121203 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-638319a7-e999-4e08-93e9-8e7543c6aa46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:51.128248 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-638319a7-e999-4e08-93e9-8e7543c6aa46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.129011 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-638319a7-e999-4e08-93e9-8e7543c6aa46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.129456 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-638319a7-e999-4e08-93e9-8e7543c6aa46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.130123 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-638319a7-e999-4e08-93e9-8e7543c6aa46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.286996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-638319a7-e999-4e08-93e9-8e7543c6aa46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:51.295803 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-638319a7-e999-4e08-93e9-8e7543c6aa46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1367 microversion: 2.1 time: 0.179063 Jun 24 08:47:51.296418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 432/859] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:51 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:51.515792 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:51.516916 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:51.523714 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.524161 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.524944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.525377 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.681493 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:51.690990 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:51.692487 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:51.693663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-be40b16e-d28c-4472-a046-8dbb2f4cd6f2 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.183109 Jun 24 08:47:51.694250 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 428/860] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:51 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:52.313515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-88d6cf03-1852-4d8f-bb4d-8c3fdaad8b42 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:52.314158 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-88d6cf03-1852-4d8f-bb4d-8c3fdaad8b42 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:52.321045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88d6cf03-1852-4d8f-bb4d-8c3fdaad8b42 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.321502 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88d6cf03-1852-4d8f-bb4d-8c3fdaad8b42 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.322334 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88d6cf03-1852-4d8f-bb4d-8c3fdaad8b42 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.322843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88d6cf03-1852-4d8f-bb4d-8c3fdaad8b42 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.480032 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-88d6cf03-1852-4d8f-bb4d-8c3fdaad8b42 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.489395 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-88d6cf03-1852-4d8f-bb4d-8c3fdaad8b42 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1556 microversion: 2.1 time: 0.179683 Jun 24 08:47:52.490116 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 433/861] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:52 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:52.508866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-907b8d5a-44d7-429f-a802-8c65c0b8ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:52.509501 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-907b8d5a-44d7-429f-a802-8c65c0b8ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:52.515837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-907b8d5a-44d7-429f-a802-8c65c0b8ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.517185 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-907b8d5a-44d7-429f-a802-8c65c0b8ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.518184 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-907b8d5a-44d7-429f-a802-8c65c0b8ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.518615 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-907b8d5a-44d7-429f-a802-8c65c0b8ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.629447 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-907b8d5a-44d7-429f-a802-8c65c0b8ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124808 Jun 24 08:47:52.630652 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 429/862] 10.222.0.13 () {58 vars in 1274 bytes} [Fri Jun 24 08:47:52 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:52.714038 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:52.714651 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:52.721846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.722292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.723270 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.723884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.870775 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.881116 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.883023 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.884602 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f8e51d3c-e50b-4f22-a610-f3967e4c08cd tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.175615 Jun 24 08:47:52.890240 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 434/863] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:52 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:53.907601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:53.908738 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:53.922169 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.923343 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.924649 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.925314 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.014414 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-666cd10d-f960-403b-baf5-0f3f5c204e43 req-7d68d92b-0212-487b-8176-35e0412ee585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57397a13-99c7-451e-8c0a-a7c6303a7fa9", "tag": "9c96470b-899f-45c4-b463-69a3cf1070d2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:54.041895 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-666cd10d-f960-403b-baf5-0f3f5c204e43 req-7d68d92b-0212-487b-8176-35e0412ee585 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.042692 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-666cd10d-f960-403b-baf5-0f3f5c204e43 req-7d68d92b-0212-487b-8176-35e0412ee585 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.074459 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-666cd10d-f960-403b-baf5-0f3f5c204e43 req-7d68d92b-0212-487b-8176-35e0412ee585 service nova] Creating event network-changed:9c96470b-899f-45c4-b463-69a3cf1070d2 for instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 on hv-cinder-84713 Jun 24 08:47:54.082449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-666cd10d-f960-403b-baf5-0f3f5c204e43 req-7d68d92b-0212-487b-8176-35e0412ee585 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073536 Jun 24 08:47:54.083870 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 435/864] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:54.242180 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:54.263297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:54.265416 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:54.266812 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cb24ad84-e59b-4df5-8f71-9c19639bc80f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.368282 Jun 24 08:47:54.278790 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 430/865] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:53 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:54.944160 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-02f26071-7968-442c-9600-247120bf87f8 req-fbed64a0-738f-4b49-8687-920e0529c429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268", "name": "network-vif-plugged", "status": "completed", "tag": "43c59752-b640-4bc3-91df-788def083aa2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:54.947974 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=56 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:54.959311 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-02f26071-7968-442c-9600-247120bf87f8 req-fbed64a0-738f-4b49-8687-920e0529c429 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.961335 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-02f26071-7968-442c-9600-247120bf87f8 req-fbed64a0-738f-4b49-8687-920e0529c429 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.976688 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-02f26071-7968-442c-9600-247120bf87f8 req-fbed64a0-738f-4b49-8687-920e0529c429 service nova] Creating event network-vif-plugged:43c59752-b640-4bc3-91df-788def083aa2 for instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 on hv-cinder-84713 Jun 24 08:47:54.988726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-02f26071-7968-442c-9600-247120bf87f8 req-fbed64a0-738f-4b49-8687-920e0529c429 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051888 Jun 24 08:47:54.990183 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 436/866] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:55.290339 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:55.292452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:55.298058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=52 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:55.311175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:55.312584 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.314812 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:55.315995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.363219 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:55.804522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:55.814455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:55.816147 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:55.817440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6000100e-be46-491a-9e45-d848d874cf3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.535834 Jun 24 08:47:55.818052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 431/867] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:55 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:56.838584 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:56.839579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:56.849641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.850427 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.851278 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.851852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.067308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:57.080186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:57.082507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:57.083807 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d3d10cf2-9ce8-4c15-9095-138ec40e1b3e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.250623 Jun 24 08:47:57.084474 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 437/868] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:56 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:58.104601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:58.106732 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:58.116068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:58.116996 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:58.118160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:58.118888 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:58.319504 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:58.334842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:58.338424 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:58.341455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2f65691c-5538-4967-87fb-c09af082f062 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1728 microversion: 2.20 time: 0.240410 Jun 24 08:47:58.342556 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 432/869] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:58 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:59.367706 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:59.368329 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:59.375871 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:59.376315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:59.377675 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:59.378210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:59.561372 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:59.570994 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:59.572954 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:59.576050 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-59cad6f9-2648-4a67-8b0e-9b02d3c3d3f8 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1715 microversion: 2.20 time: 0.211798 Jun 24 08:47:59.576893 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 438/870] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:59 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1715 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:09.768188 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-388441143", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:09.778022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:09.778529 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=10 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:09.847828 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] validate_networks() for None {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:48:10.197784 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:48:10.198212 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:48:10.198724 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:48:10.199164 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:48:10.200313 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:48:10.211802 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:10.212241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.213035 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:10.213465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.234442 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Getting quotas for project 0d4721b2f8834f2fa81aa7d0d5f090e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:10.239267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Getting quotas for user 10e2d2ab314c4c55a4100384d93ea93f and project 0d4721b2f8834f2fa81aa7d0d5f090e2. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:10.256841 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:48:10.259319 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:48:10.307622 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0285f9ab-bf4a-41bc-ba9e-cae0eaf70b7f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543319 Jun 24 08:48:10.308459 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 433/871] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:48:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:48:10.326787 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d3891ac8-ab8b-4cdc-9588-a1b725512798 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:10.327910 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d3891ac8-ab8b-4cdc-9588-a1b725512798 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:10.331664 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=5 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:10.332634 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=45 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:10.431310 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d3891ac8-ab8b-4cdc-9588-a1b725512798 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:10.439713 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d3891ac8-ab8b-4cdc-9588-a1b725512798 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1214 microversion: 2.1 time: 0.120531 Jun 24 08:48:10.440470 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 439/872] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:10 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:11.459837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd635991-0e45-4b63-af8d-cf44292fcd59 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:11.460527 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dd635991-0e45-4b63-af8d-cf44292fcd59 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:11.468170 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd635991-0e45-4b63-af8d-cf44292fcd59 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.468611 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd635991-0e45-4b63-af8d-cf44292fcd59 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.469481 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd635991-0e45-4b63-af8d-cf44292fcd59 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.469944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd635991-0e45-4b63-af8d-cf44292fcd59 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.558564 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dd635991-0e45-4b63-af8d-cf44292fcd59 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:11.572762 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dd635991-0e45-4b63-af8d-cf44292fcd59 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1274 microversion: 2.1 time: 0.116869 Jun 24 08:48:11.573754 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 434/873] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:11 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:12.599717 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3157abf6-5948-441f-af04-c171144b7199 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:12.600445 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3157abf6-5948-441f-af04-c171144b7199 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:12.608207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3157abf6-5948-441f-af04-c171144b7199 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.608754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3157abf6-5948-441f-af04-c171144b7199 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:12.609961 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3157abf6-5948-441f-af04-c171144b7199 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.610478 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3157abf6-5948-441f-af04-c171144b7199 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:12.930557 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3157abf6-5948-441f-af04-c171144b7199 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:12.943360 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3157abf6-5948-441f-af04-c171144b7199 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1314 microversion: 2.1 time: 0.347613 Jun 24 08:48:12.944428 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 440/874] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:12 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:13.464720 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-8fdcd249-1f6d-407c-9d18-7b97d970b36f req-ff01b660-d098-4c45-a28b-3d89b20a4ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad5ab31-d398-48ca-9206-2d937f08771c", "tag": "37ae926b-d415-4ce6-94ed-8c634b9dd6de"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:13.488476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8fdcd249-1f6d-407c-9d18-7b97d970b36f req-ff01b660-d098-4c45-a28b-3d89b20a4ac9 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.489127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8fdcd249-1f6d-407c-9d18-7b97d970b36f req-ff01b660-d098-4c45-a28b-3d89b20a4ac9 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.520101 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-8fdcd249-1f6d-407c-9d18-7b97d970b36f req-ff01b660-d098-4c45-a28b-3d89b20a4ac9 service nova] Creating event network-changed:37ae926b-d415-4ce6-94ed-8c634b9dd6de for instance 8ad5ab31-d398-48ca-9206-2d937f08771c on hv-cinder-84713 Jun 24 08:48:13.527919 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-8fdcd249-1f6d-407c-9d18-7b97d970b36f req-ff01b660-d098-4c45-a28b-3d89b20a4ac9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069705 Jun 24 08:48:13.528748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 435/875] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:13.970749 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-49836768-1191-4d7f-8292-459fe99eb363 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:13.971532 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-49836768-1191-4d7f-8292-459fe99eb363 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:13.979206 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49836768-1191-4d7f-8292-459fe99eb363 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.979655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49836768-1191-4d7f-8292-459fe99eb363 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.980438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49836768-1191-4d7f-8292-459fe99eb363 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.981401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49836768-1191-4d7f-8292-459fe99eb363 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.129898 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-49836768-1191-4d7f-8292-459fe99eb363 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.138170 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-49836768-1191-4d7f-8292-459fe99eb363 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1314 microversion: 2.1 time: 0.173337 Jun 24 08:48:14.138938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 441/876] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:13 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:15.161126 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-87cc3d71-d6b6-470e-9ded-c845c27517cd tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:15.162264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-87cc3d71-d6b6-470e-9ded-c845c27517cd tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:15.174017 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87cc3d71-d6b6-470e-9ded-c845c27517cd tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.174816 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87cc3d71-d6b6-470e-9ded-c845c27517cd tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.176322 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87cc3d71-d6b6-470e-9ded-c845c27517cd tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.177113 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87cc3d71-d6b6-470e-9ded-c845c27517cd tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.422730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-87cc3d71-d6b6-470e-9ded-c845c27517cd tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:15.432266 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-87cc3d71-d6b6-470e-9ded-c845c27517cd tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1314 microversion: 2.1 time: 0.279335 Jun 24 08:48:15.432918 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 436/877] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:15 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:16.458218 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-53d6a03c-9c33-422f-9de5-65bd039165c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:16.458831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-53d6a03c-9c33-422f-9de5-65bd039165c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:16.466066 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-53d6a03c-9c33-422f-9de5-65bd039165c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.466524 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-53d6a03c-9c33-422f-9de5-65bd039165c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.467294 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-53d6a03c-9c33-422f-9de5-65bd039165c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.467729 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-53d6a03c-9c33-422f-9de5-65bd039165c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.660127 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-53d6a03c-9c33-422f-9de5-65bd039165c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:16.668579 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-53d6a03c-9c33-422f-9de5-65bd039165c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1314 microversion: 2.1 time: 0.214410 Jun 24 08:48:16.669246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 442/878] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:16 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:17.686633 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-177a6ff3-7a96-44ea-b3b6-ff1a384121c8 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:17.687541 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-177a6ff3-7a96-44ea-b3b6-ff1a384121c8 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:17.694193 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-177a6ff3-7a96-44ea-b3b6-ff1a384121c8 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.694638 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-177a6ff3-7a96-44ea-b3b6-ff1a384121c8 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.695626 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-177a6ff3-7a96-44ea-b3b6-ff1a384121c8 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.696088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-177a6ff3-7a96-44ea-b3b6-ff1a384121c8 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.837195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-177a6ff3-7a96-44ea-b3b6-ff1a384121c8 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:17.846014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-177a6ff3-7a96-44ea-b3b6-ff1a384121c8 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1314 microversion: 2.1 time: 0.164237 Jun 24 08:48:17.846617 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 437/879] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:17 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:18.864504 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9dd96029-70fb-472c-99e9-4b17e681e521 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:18.865078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9dd96029-70fb-472c-99e9-4b17e681e521 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:18.873341 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dd96029-70fb-472c-99e9-4b17e681e521 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:18.873341 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dd96029-70fb-472c-99e9-4b17e681e521 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:18.873719 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dd96029-70fb-472c-99e9-4b17e681e521 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:18.874168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dd96029-70fb-472c-99e9-4b17e681e521 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.016830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-85816933-9730-4d2f-a3e5-4afc28232898 req-356e1640-68a5-4daf-9dbc-bf1c6ccf234e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad5ab31-d398-48ca-9206-2d937f08771c", "name": "network-vif-plugged", "status": "completed", "tag": "37ae926b-d415-4ce6-94ed-8c634b9dd6de"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:19.030931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-85816933-9730-4d2f-a3e5-4afc28232898 req-356e1640-68a5-4daf-9dbc-bf1c6ccf234e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.042009 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-85816933-9730-4d2f-a3e5-4afc28232898 req-356e1640-68a5-4daf-9dbc-bf1c6ccf234e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.050325 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-85816933-9730-4d2f-a3e5-4afc28232898 req-356e1640-68a5-4daf-9dbc-bf1c6ccf234e service nova] Creating event network-vif-plugged:37ae926b-d415-4ce6-94ed-8c634b9dd6de for instance 8ad5ab31-d398-48ca-9206-2d937f08771c on hv-cinder-84713 Jun 24 08:48:19.055963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-85816933-9730-4d2f-a3e5-4afc28232898 req-356e1640-68a5-4daf-9dbc-bf1c6ccf234e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046314 Jun 24 08:48:19.056996 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 438/880] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:19.066127 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9dd96029-70fb-472c-99e9-4b17e681e521 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:19.075794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9dd96029-70fb-472c-99e9-4b17e681e521 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1314 microversion: 2.1 time: 0.215415 Jun 24 08:48:19.076621 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 443/881] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:18 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:20.099217 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-822f86e5-27ed-4c31-bd7c-ce115c36063f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:20.099934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-822f86e5-27ed-4c31-bd7c-ce115c36063f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:20.110667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-822f86e5-27ed-4c31-bd7c-ce115c36063f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.110667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-822f86e5-27ed-4c31-bd7c-ce115c36063f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.110667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-822f86e5-27ed-4c31-bd7c-ce115c36063f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.110667 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-822f86e5-27ed-4c31-bd7c-ce115c36063f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.223260 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:20.246751 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:20.266964 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-822f86e5-27ed-4c31-bd7c-ce115c36063f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:20.274953 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-822f86e5-27ed-4c31-bd7c-ce115c36063f tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1314 microversion: 2.1 time: 0.181098 Jun 24 08:48:20.275663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 439/882] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:20 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:21.292646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-68fd4b96-33ce-414d-a460-94dc2b1133aa tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:21.294011 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-68fd4b96-33ce-414d-a460-94dc2b1133aa tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:21.295847 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:21.301887 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68fd4b96-33ce-414d-a460-94dc2b1133aa tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.302375 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68fd4b96-33ce-414d-a460-94dc2b1133aa tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.303286 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68fd4b96-33ce-414d-a460-94dc2b1133aa tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.303779 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68fd4b96-33ce-414d-a460-94dc2b1133aa tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.457539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-68fd4b96-33ce-414d-a460-94dc2b1133aa tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:21.466058 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-68fd4b96-33ce-414d-a460-94dc2b1133aa tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1463 microversion: 2.1 time: 0.177233 Jun 24 08:48:21.466650 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 444/883] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:21 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:21.508306 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1cd3a967-923d-4310-b4ac-8f74c6d66715 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:21.508923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1cd3a967-923d-4310-b4ac-8f74c6d66715 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:21.516462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1cd3a967-923d-4310-b4ac-8f74c6d66715 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.516901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1cd3a967-923d-4310-b4ac-8f74c6d66715 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.517724 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1cd3a967-923d-4310-b4ac-8f74c6d66715 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.518167 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1cd3a967-923d-4310-b4ac-8f74c6d66715 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.546387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1cd3a967-923d-4310-b4ac-8f74c6d66715 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:48:21.632449 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1cd3a967-923d-4310-b4ac-8f74c6d66715 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 204 len: 0 microversion: 2.1 time: 0.128027 Jun 24 08:48:21.633387 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 440/884] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:48:21 2022] DELETE /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:48:21.642829 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5df92f3b-9419-4f5b-92ae-4e735334eb36 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:21.643451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5df92f3b-9419-4f5b-92ae-4e735334eb36 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:21.649837 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5df92f3b-9419-4f5b-92ae-4e735334eb36 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.650290 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5df92f3b-9419-4f5b-92ae-4e735334eb36 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.651064 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5df92f3b-9419-4f5b-92ae-4e735334eb36 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.651506 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5df92f3b-9419-4f5b-92ae-4e735334eb36 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.799611 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5df92f3b-9419-4f5b-92ae-4e735334eb36 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:21.807233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5df92f3b-9419-4f5b-92ae-4e735334eb36 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1469 microversion: 2.1 time: 0.168239 Jun 24 08:48:21.807883 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 445/885] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:21 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:22.827290 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-20fca7a1-66b7-415e-be93-7db1105c70c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:22.828035 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-20fca7a1-66b7-415e-be93-7db1105c70c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:22.834803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20fca7a1-66b7-415e-be93-7db1105c70c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.835244 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20fca7a1-66b7-415e-be93-7db1105c70c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.836031 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20fca7a1-66b7-415e-be93-7db1105c70c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.836456 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20fca7a1-66b7-415e-be93-7db1105c70c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.987146 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-20fca7a1-66b7-415e-be93-7db1105c70c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:22.994907 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-20fca7a1-66b7-415e-be93-7db1105c70c4 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1469 microversion: 2.1 time: 0.172735 Jun 24 08:48:22.995499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 441/886] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:22 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:23.948652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-8a9cf7a3-6e6a-4998-bac5-27624d7018cc req-c1747241-f8e2-4c98-8446-c93686c3551e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad5ab31-d398-48ca-9206-2d937f08771c", "name": "network-vif-deleted", "tag": "37ae926b-d415-4ce6-94ed-8c634b9dd6de"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:23.964386 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-8a9cf7a3-6e6a-4998-bac5-27624d7018cc req-c1747241-f8e2-4c98-8446-c93686c3551e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:23.966329 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-8a9cf7a3-6e6a-4998-bac5-27624d7018cc req-c1747241-f8e2-4c98-8446-c93686c3551e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.988052 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-8a9cf7a3-6e6a-4998-bac5-27624d7018cc req-c1747241-f8e2-4c98-8446-c93686c3551e service nova] Creating event network-vif-deleted:37ae926b-d415-4ce6-94ed-8c634b9dd6de for instance 8ad5ab31-d398-48ca-9206-2d937f08771c on hv-cinder-84713 Jun 24 08:48:23.997525 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-8a9cf7a3-6e6a-4998-bac5-27624d7018cc req-c1747241-f8e2-4c98-8446-c93686c3551e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053817 Jun 24 08:48:23.998824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 446/887] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:24.017535 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f8a52229-c68e-4a3c-8ff9-612015d9e155 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:24.019717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f8a52229-c68e-4a3c-8ff9-612015d9e155 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:24.032543 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8a52229-c68e-4a3c-8ff9-612015d9e155 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.034066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8a52229-c68e-4a3c-8ff9-612015d9e155 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.035839 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8a52229-c68e-4a3c-8ff9-612015d9e155 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.037521 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8a52229-c68e-4a3c-8ff9-612015d9e155 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.147181 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f8a52229-c68e-4a3c-8ff9-612015d9e155 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e2d2ab314c4c55a4100384d93ea93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4721b2f8834f2fa81aa7d0d5f090e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:24.155507 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f8a52229-c68e-4a3c-8ff9-612015d9e155 tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 200 len: 1299 microversion: 2.1 time: 0.145526 Jun 24 08:48:24.156142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 442/888] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:24 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:25.174459 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:25.175172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] [instance: 8ad5ab31-d398-48ca-9206-2d937f08771c] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:25.182254 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:25.182707 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:25.183580 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:25.184035 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:25.199773 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] HTTP exception thrown: Instance 8ad5ab31-d398-48ca-9206-2d937f08771c could not be found. Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Request method failure captured: Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c HTTP/1.1 Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXpHHzWJm86YOFwAgGgRccfT8ZaA6ph6YYe9x0hXe1NxpZkJxqnofL-3a82lekGyLqqIhJ4DD4mBD47NSeo4UPO1YYqvrzQB6xSRkExTx_ClSIIDLajAXyaz_FSggdhY4FaDEK_uXnu027NMC5kaSvQ1HpSYO_Ua4svA2hQIpbu-A88 Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 0d4721b2f8834f2fa81aa7d0d5f090e2 Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-1890822434 Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:48:25.201512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0d4721b2f8834f2fa81aa7d0d5f090e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0d4721b2f8834f2fa81aa7d0d5f090e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0d4721b2f8834f2fa81aa7d0d5f090e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0d4721b2f8834f2fa81aa7d0d5f090e2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-1890822434 Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0d4721b2f8834f2fa81aa7d0d5f090e2 Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-1890822434 Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-1890822434-project Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 10e2d2ab314c4c55a4100384d93ea93f Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-1890822434-project Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 8ad5ab31-d398-48ca-9206-2d937f08771c could not be found. Jun 24 08:48:25.204106 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '8ad5ab31-d398-48ca-9206-2d937f08771c'} Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad5ab31-d398-48ca-9206-2d937f08771c could not be found. Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:25.205588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad5ab31-d398-48ca-9206-2d937f08771c could not be found. Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad5ab31-d398-48ca-9206-2d937f08771c could not be found. Jun 24 08:48:25.208210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:25.211103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] Returning 404 to user: Instance 8ad5ab31-d398-48ca-9206-2d937f08771c could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:25.211103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-693d95f6-67e5-4226-9098-3bd674d8402d tempest-VolumesNegativeTest-1890822434 tempest-VolumesNegativeTest-1890822434-project] 10.222.0.13 "GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c" status: 404 len: 111 microversion: 2.1 time: 0.033835 Jun 24 08:48:25.211103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 447/889] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:25 2022] GET /compute/v2.1/servers/8ad5ab31-d398-48ca-9206-2d937f08771c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:48:30.410142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-05c5cf99-5326-41ec-bff1-90123a6b5d6d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:30.410894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-05c5cf99-5326-41ec-bff1-90123a6b5d6d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:30.418254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05c5cf99-5326-41ec-bff1-90123a6b5d6d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.418781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05c5cf99-5326-41ec-bff1-90123a6b5d6d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.419600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05c5cf99-5326-41ec-bff1-90123a6b5d6d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.420036 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05c5cf99-5326-41ec-bff1-90123a6b5d6d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.447555 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-05c5cf99-5326-41ec-bff1-90123a6b5d6d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/ips" status: 200 len: 148 microversion: 2.1 time: 0.041323 Jun 24 08:48:30.448139 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 443/890] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:48:30 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:31.883963 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8095255f-4913-4c6c-a020-66626a086163 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7699b001-b375-4149-a389-7f37c31c4b55"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:31.886031 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8095255f-4913-4c6c-a020-66626a086163 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:31.898318 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8095255f-4913-4c6c-a020-66626a086163 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:31.899103 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8095255f-4913-4c6c-a020-66626a086163 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:31.900485 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8095255f-4913-4c6c-a020-66626a086163 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:31.901325 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8095255f-4913-4c6c-a020-66626a086163 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.209838 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8095255f-4913-4c6c-a020-66626a086163 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333169 Jun 24 08:48:32.210696 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 448/891] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:48:31 2022] POST /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:32.753155 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f36fc218-14e7-4df2-9da9-0ed2caaa779d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:32.754143 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f36fc218-14e7-4df2-9da9-0ed2caaa779d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:32.760973 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f36fc218-14e7-4df2-9da9-0ed2caaa779d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.761419 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f36fc218-14e7-4df2-9da9-0ed2caaa779d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.763051 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f36fc218-14e7-4df2-9da9-0ed2caaa779d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.763534 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f36fc218-14e7-4df2-9da9-0ed2caaa779d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.798462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f36fc218-14e7-4df2-9da9-0ed2caaa779d tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049462 Jun 24 08:48:32.799267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 444/892] 10.222.0.13 () {60 vars in 1342 bytes} [Fri Jun 24 08:48:32 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:32.880832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-54cd344b-787b-4dd4-b5ff-e90c5516f8ec tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:32.881834 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-54cd344b-787b-4dd4-b5ff-e90c5516f8ec tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:32.893996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-54cd344b-787b-4dd4-b5ff-e90c5516f8ec tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.894761 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-54cd344b-787b-4dd4-b5ff-e90c5516f8ec tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.896058 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-54cd344b-787b-4dd4-b5ff-e90c5516f8ec tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.896794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-54cd344b-787b-4dd4-b5ff-e90c5516f8ec tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.944938 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-54cd344b-787b-4dd4-b5ff-e90c5516f8ec tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:48:33.054509 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-54cd344b-787b-4dd4-b5ff-e90c5516f8ec tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 204 len: 0 microversion: 2.20 time: 0.182854 Jun 24 08:48:33.055215 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 449/893] 10.222.0.13 () {60 vars in 1279 bytes} [Fri Jun 24 08:48:32 2022] DELETE /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:48:33.066169 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:33.066779 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:33.073027 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:33.073465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:33.074819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:33.075460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:33.243093 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:33.253638 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:33.255394 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:33.256832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fe0f1fb4-8056-4a66-85a6-31b9852ab8d4 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.194599 Jun 24 08:48:33.257467 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 445/894] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:33 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:34.278132 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:34.279640 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:34.286623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:34.287073 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:34.287850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:34.288287 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:34.447760 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:34.458023 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:34.459540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:34.460740 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5c1d1a66-afd1-4ea9-8d66-8718272300f0 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.187897 Jun 24 08:48:34.461293 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 450/895] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:34 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:35.482784 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:35.483597 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:35.493963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:35.494664 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:35.496431 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:35.497105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:35.864841 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:35.873734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:35.875247 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75a612089b2b46a6b3ff5a6cd9e59579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de333e57ed34492bee6491335ff4356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:35.876431 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d13e4221-60a4-4d83-97d2-d324ff5d988f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 200 len: 1721 microversion: 2.20 time: 0.400011 Jun 24 08:48:35.877198 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 446/896] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:35 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:36.151199 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-0ef0b561-d3b6-4359-8125-42db17eaf747 req-af255356-6beb-4df0-bd1a-fae4d9bf5a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268", "name": "network-vif-deleted", "tag": "43c59752-b640-4bc3-91df-788def083aa2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:36.161516 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0ef0b561-d3b6-4359-8125-42db17eaf747 req-af255356-6beb-4df0-bd1a-fae4d9bf5a22 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.162167 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0ef0b561-d3b6-4359-8125-42db17eaf747 req-af255356-6beb-4df0-bd1a-fae4d9bf5a22 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.180379 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-0ef0b561-d3b6-4359-8125-42db17eaf747 req-af255356-6beb-4df0-bd1a-fae4d9bf5a22 service nova] Creating event network-vif-deleted:43c59752-b640-4bc3-91df-788def083aa2 for instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 on hv-cinder-84713 Jun 24 08:48:36.190608 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-0ef0b561-d3b6-4359-8125-42db17eaf747 req-af255356-6beb-4df0-bd1a-fae4d9bf5a22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044176 Jun 24 08:48:36.191522 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 451/897] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:48:36.909095 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:36.911087 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:36.924066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.924829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.926265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.927073 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.952446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] HTTP exception thrown: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Request method failure captured: Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 HTTP/1.1 Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiJ1yxU6gwMcKvuQyuNGHDcQBaUMe_tWbJCx2e_xLMqLKeRGQYDLeDjg-_iwkGgC5eirjUddisj3Txq6mTmYjN6skyyIgw3diO3Ec4SBv3bH6ZK095aaq16cgb3U_096OvJRTiB6sficN1Ghu7S4lvIsBewgfCMuYrzmRrapBx92YI Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:48:36.954348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4de333e57ed34492bee6491335ff4356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4de333e57ed34492bee6491335ff4356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 75a612089b2b46a6b3ff5a6cd9e59579 Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:36.957354 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': 'c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268'} Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:36.958885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:36.962525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:36.965671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Returning 404 to user: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:36.965671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bb94eccf-15ce-4ac7-a1fd-59d35b37889f tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 404 len: 111 microversion: 2.20 time: 0.054725 Jun 24 08:48:36.965671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 447/898] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:36 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:48:36.969151 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9b060e7f-b847-4d1e-9c35-a3d3e62208de tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '.version_select at 0x7f0a6fea3160>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:36.992949 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9b060e7f-b847-4d1e-9c35-a3d3e62208de tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954309447" status: 204 len: 0 microversion: 2.20 time: 0.027798 Jun 24 08:48:36.993315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 452/899] 10.222.0.13 () {60 vars in 1258 bytes} [Fri Jun 24 08:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954309447 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 08:48:39.014723 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:39.015370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:39.022105 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.022552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.023332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.023768 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.040928 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] HTTP exception thrown: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Request method failure captured: Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 HTTP/1.1 Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiJ1yxU6gwMcKvuQyuNGHDcQBaUMe_tWbJCx2e_xLMqLKeRGQYDLeDjg-_iwkGgC5eirjUddisj3Txq6mTmYjN6skyyIgw3diO3Ec4SBv3bH6ZK095aaq16cgb3U_096OvJRTiB6sficN1Ghu7S4lvIsBewgfCMuYrzmRrapBx92YI Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:48:39.042587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4de333e57ed34492bee6491335ff4356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4de333e57ed34492bee6491335ff4356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 75a612089b2b46a6b3ff5a6cd9e59579 Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.045859 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': 'c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268'} Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:39.046982 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.049109 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.052855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Returning 404 to user: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:39.052855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-105d4e50-82a0-4218-ac3e-88c63494960a tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 404 len: 111 microversion: 2.20 time: 0.034290 Jun 24 08:48:39.052855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 448/900] 10.222.0.13 () {60 vars in 1279 bytes} [Fri Jun 24 08:48:39 2022] DELETE /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:48:39.057008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:39.057907 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:39.064557 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.065013 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.065822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.066267 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.080738 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] HTTP exception thrown: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Request method failure captured: Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 HTTP/1.1 Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiJ1yxU6gwMcKvuQyuNGHDcQBaUMe_tWbJCx2e_xLMqLKeRGQYDLeDjg-_iwkGgC5eirjUddisj3Txq6mTmYjN6skyyIgw3diO3Ec4SBv3bH6ZK095aaq16cgb3U_096OvJRTiB6sficN1Ghu7S4lvIsBewgfCMuYrzmRrapBx92YI Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:48:39.082482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4de333e57ed34492bee6491335ff4356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4de333e57ed34492bee6491335ff4356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 75a612089b2b46a6b3ff5a6cd9e59579 Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.084986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268'} Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:39.086498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. Jun 24 08:48:39.088968 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.091844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Returning 404 to user: Instance c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:39.091844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5068aeb2-cea7-44bf-9b1d-7c08912cd96c tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268" status: 404 len: 111 microversion: 2.20 time: 0.032975 Jun 24 08:48:39.091844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 453/901] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:39 2022] GET /compute/v2.1/servers/c99f8bb2-1b7c-4cf6-a23d-79d0ed3df268 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:48:39.989366 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7f5f584f-eb4d-460b-99a0-994b8c1097ab tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: .version_select at 0x7f0a7c7c1ee0>, body: {"keypair": {"name": "tempest-keypair-1887298264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVsW2O83r3+RHY2Vv/dInphmNLB8BF4tAEaHw7FrddFr5HxnEzgAw15cWnJGpqpVa9vfLC+1QICWLkRVUBiIQ42QJ+bcCqmuqI+nGEE71joqJuxgiGURNxlrXgHNKMRug=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:39.997835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:40.022160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-7f5f584f-eb4d-460b-99a0-994b8c1097ab tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for project 7787ee132e9e4e23b1407718fb366406. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:40.029134 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-7f5f584f-eb4d-460b-99a0-994b8c1097ab tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for user 8d15a76041274e7381087bd21eb674c9 and project 7787ee132e9e4e23b1407718fb366406. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:40.068191 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7f5f584f-eb4d-460b-99a0-994b8c1097ab tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084840 Jun 24 08:48:40.068843 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 449/902] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:48:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:40.242801 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:40.243527 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:40.253478 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.254322 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.255693 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.256474 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.275148 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] HTTP exception thrown: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Request method failure captured: Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 HTTP/1.1 Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXiJ1yxU6gwMcKvuQyuNGHDcQBaUMe_tWbJCx2e_xLMqLKeRGQYDLeDjg-_iwkGgC5eirjUddisj3Txq6mTmYjN6skyyIgw3diO3Ec4SBv3bH6ZK095aaq16cgb3U_096OvJRTiB6sficN1Ghu7S4lvIsBewgfCMuYrzmRrapBx92YI Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:48:40.276715 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4de333e57ed34492bee6491335ff4356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4de333e57ed34492bee6491335ff4356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 75a612089b2b46a6b3ff5a6cd9e59579 Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.278741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '2ebf6c82-2da5-46c9-8757-4fa70bfa79b1'} Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:40.279515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.280788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.282047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Returning 404 to user: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:40.282047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-21882fb5-bf34-4a7f-8d18-af1181349949 tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 404 len: 111 microversion: 2.20 time: 0.040097 Jun 24 08:48:40.282047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 454/903] 10.222.0.13 () {60 vars in 1279 bytes} [Fri Jun 24 08:48:40 2022] DELETE /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:48:40.288376 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:40.289035 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] [instance: 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:40.296627 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.297067 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.298114 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.299854 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.303049 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:40.317857 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] HTTP exception thrown: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Request method failure captured: Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 HTTP/1.1 Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXiJ1yxU6gwMcKvuQyuNGHDcQBaUMe_tWbJCx2e_xLMqLKeRGQYDLeDjg-_iwkGgC5eirjUddisj3Txq6mTmYjN6skyyIgw3diO3Ec4SBv3bH6ZK095aaq16cgb3U_096OvJRTiB6sficN1Ghu7S4lvIsBewgfCMuYrzmRrapBx92YI Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:48:40.319770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4de333e57ed34492bee6491335ff4356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4de333e57ed34492bee6491335ff4356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4de333e57ed34492bee6491335ff4356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 4de333e57ed34492bee6491335ff4356 Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1917118963 Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 75a612089b2b46a6b3ff5a6cd9e59579 Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1917118963-project Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.321553 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '2ebf6c82-2da5-46c9-8757-4fa70bfa79b1'} Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:40.322497 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. Jun 24 08:48:40.324469 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:40.325678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] Returning 404 to user: Instance 2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:40.325678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7407f2b1-0041-40ea-aaa9-5b66341bc44e tempest-AttachVolumeShelveTestJSON-1917118963 tempest-AttachVolumeShelveTestJSON-1917118963-project] 10.222.0.13 "GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1" status: 404 len: 111 microversion: 2.20 time: 0.038235 Jun 24 08:48:40.325678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 450/904] 10.222.0.13 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:40 2022] GET /compute/v2.1/servers/2ebf6c82-2da5-46c9-8757-4fa70bfa79b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:48:42.008179 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1746786314", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f76c266-a8af-466b-8b61-0e931014df30"}], "security_groups": [{"name": "tempest-securitygroup--141433166"}], "key_name": "tempest-keypair-1887298264", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:42.021326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:42.151094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] validate_networks() for [('0f76c266-a8af-466b-8b61-0e931014df30', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:48:42.720826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:48:42.721628 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:48:42.722585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:48:42.723460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:48:42.724061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:48:42.737236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:42.737826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:42.738757 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:42.739256 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:42.750860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:42.769551 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for project 7787ee132e9e4e23b1407718fb366406. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:42.775153 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for user 8d15a76041274e7381087bd21eb674c9 and project 7787ee132e9e4e23b1407718fb366406. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:42.794384 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:48:42.797128 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:48:42.864056 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-376d217d-3163-4517-9c31-628a6920be61 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.864076 Jun 24 08:48:42.865156 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 455/905] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:48:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:48:42.883830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e822b3c6-3d2e-4c22-9837-3ff7000eb7b2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:42.885093 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e822b3c6-3d2e-4c22-9837-3ff7000eb7b2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:42.975222 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e822b3c6-3d2e-4c22-9837-3ff7000eb7b2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:42.991417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e822b3c6-3d2e-4c22-9837-3ff7000eb7b2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1242 microversion: 2.1 time: 0.115164 Jun 24 08:48:42.992318 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 451/906] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:42 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:44.013084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8125ad36-29c6-4511-9737-3c8f6ce06924 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:44.014787 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8125ad36-29c6-4511-9737-3c8f6ce06924 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:44.022659 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8125ad36-29c6-4511-9737-3c8f6ce06924 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.023275 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8125ad36-29c6-4511-9737-3c8f6ce06924 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.024429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8125ad36-29c6-4511-9737-3c8f6ce06924 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.025358 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8125ad36-29c6-4511-9737-3c8f6ce06924 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.201982 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8125ad36-29c6-4511-9737-3c8f6ce06924 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:44.214853 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8125ad36-29c6-4511-9737-3c8f6ce06924 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1238 microversion: 2.1 time: 0.206391 Jun 24 08:48:44.225944 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 456/907] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:44 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1238 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:45.236554 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c42a6cdf-19a2-4d65-b084-c7146e8a562b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:45.237591 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c42a6cdf-19a2-4d65-b084-c7146e8a562b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:45.250817 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c42a6cdf-19a2-4d65-b084-c7146e8a562b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:45.251818 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c42a6cdf-19a2-4d65-b084-c7146e8a562b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:45.253381 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c42a6cdf-19a2-4d65-b084-c7146e8a562b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:45.254160 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c42a6cdf-19a2-4d65-b084-c7146e8a562b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:45.395417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c42a6cdf-19a2-4d65-b084-c7146e8a562b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:45.404391 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c42a6cdf-19a2-4d65-b084-c7146e8a562b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1300 microversion: 2.1 time: 0.175127 Jun 24 08:48:45.405347 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 452/908] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:45 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:46.427694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d9cd0c67-4297-4265-91c8-679fe7f9cb1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:46.428863 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d9cd0c67-4297-4265-91c8-679fe7f9cb1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:46.440814 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9cd0c67-4297-4265-91c8-679fe7f9cb1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:46.442198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9cd0c67-4297-4265-91c8-679fe7f9cb1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:46.443821 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9cd0c67-4297-4265-91c8-679fe7f9cb1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:46.444986 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9cd0c67-4297-4265-91c8-679fe7f9cb1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:46.755503 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d9cd0c67-4297-4265-91c8-679fe7f9cb1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:46.764788 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d9cd0c67-4297-4265-91c8-679fe7f9cb1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1367 microversion: 2.1 time: 0.344836 Jun 24 08:48:46.774564 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 457/909] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:46 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:46.917020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-227b6135-5d78-41fa-85f2-c373339bae00 req-9db71d7d-d6a1-4c46-8ee3-a8771c40ec42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc", "tag": "db1380f2-5023-4908-b975-28df4d44f376"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:46.945479 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-227b6135-5d78-41fa-85f2-c373339bae00 req-9db71d7d-d6a1-4c46-8ee3-a8771c40ec42 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:46.945964 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-227b6135-5d78-41fa-85f2-c373339bae00 req-9db71d7d-d6a1-4c46-8ee3-a8771c40ec42 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:46.977201 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-227b6135-5d78-41fa-85f2-c373339bae00 req-9db71d7d-d6a1-4c46-8ee3-a8771c40ec42 service nova] Creating event network-changed:db1380f2-5023-4908-b975-28df4d44f376 for instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc on hv-cinder-84713 Jun 24 08:48:46.985119 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-227b6135-5d78-41fa-85f2-c373339bae00 req-9db71d7d-d6a1-4c46-8ee3-a8771c40ec42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076568 Jun 24 08:48:46.986063 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 453/910] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:47.795327 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-28c85890-4d0c-4d91-af85-80f6b5f43a86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:47.796421 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-28c85890-4d0c-4d91-af85-80f6b5f43a86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:47.805643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28c85890-4d0c-4d91-af85-80f6b5f43a86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:47.806480 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28c85890-4d0c-4d91-af85-80f6b5f43a86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:47.807764 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28c85890-4d0c-4d91-af85-80f6b5f43a86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:47.808981 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28c85890-4d0c-4d91-af85-80f6b5f43a86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:48.004223 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-28c85890-4d0c-4d91-af85-80f6b5f43a86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:48.015733 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-28c85890-4d0c-4d91-af85-80f6b5f43a86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1367 microversion: 2.1 time: 0.235601 Jun 24 08:48:48.016409 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 458/911] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:47 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:49.036893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f39f50e5-55ce-4ca9-9a52-2e66930f7ac9 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:49.037600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f39f50e5-55ce-4ca9-9a52-2e66930f7ac9 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:49.046505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f39f50e5-55ce-4ca9-9a52-2e66930f7ac9 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:49.047300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f39f50e5-55ce-4ca9-9a52-2e66930f7ac9 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:49.048213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f39f50e5-55ce-4ca9-9a52-2e66930f7ac9 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:49.049136 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f39f50e5-55ce-4ca9-9a52-2e66930f7ac9 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:49.238269 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f39f50e5-55ce-4ca9-9a52-2e66930f7ac9 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:49.247369 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f39f50e5-55ce-4ca9-9a52-2e66930f7ac9 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1367 microversion: 2.1 time: 0.216631 Jun 24 08:48:49.247955 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 454/912] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:49 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:50.268839 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7795d449-7937-4283-8e39-131762ad30a1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:50.269728 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7795d449-7937-4283-8e39-131762ad30a1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:50.277875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7795d449-7937-4283-8e39-131762ad30a1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:50.278639 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7795d449-7937-4283-8e39-131762ad30a1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:50.279538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7795d449-7937-4283-8e39-131762ad30a1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:50.280175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7795d449-7937-4283-8e39-131762ad30a1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:50.466698 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7795d449-7937-4283-8e39-131762ad30a1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:50.474764 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7795d449-7937-4283-8e39-131762ad30a1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1367 microversion: 2.1 time: 0.210645 Jun 24 08:48:50.475348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 459/913] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:50 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:51.493611 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d7b57bd2-43cf-4824-9bbf-8abea561e372 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:51.494351 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d7b57bd2-43cf-4824-9bbf-8abea561e372 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:51.503272 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7b57bd2-43cf-4824-9bbf-8abea561e372 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:51.503832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7b57bd2-43cf-4824-9bbf-8abea561e372 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:51.504730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7b57bd2-43cf-4824-9bbf-8abea561e372 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:51.505218 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7b57bd2-43cf-4824-9bbf-8abea561e372 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:51.668801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d7b57bd2-43cf-4824-9bbf-8abea561e372 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:51.676335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d7b57bd2-43cf-4824-9bbf-8abea561e372 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1367 microversion: 2.1 time: 0.187046 Jun 24 08:48:51.676920 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 455/914] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:51 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:52.692920 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-86590a24-2596-46b0-a9f4-117296defbd7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:52.693539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-86590a24-2596-46b0-a9f4-117296defbd7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:52.700852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86590a24-2596-46b0-a9f4-117296defbd7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:52.701306 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86590a24-2596-46b0-a9f4-117296defbd7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:52.702131 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86590a24-2596-46b0-a9f4-117296defbd7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:52.702572 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86590a24-2596-46b0-a9f4-117296defbd7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:52.751692 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:52.786325 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:52.861606 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-86590a24-2596-46b0-a9f4-117296defbd7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:52.870536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-86590a24-2596-46b0-a9f4-117296defbd7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1367 microversion: 2.1 time: 0.181279 Jun 24 08:48:52.871167 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 460/915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:52 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:53.081176 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-5ccb67cf-033c-4b17-9cd4-60e6a3a7c06b req-bd31f813-2e6c-4806-b763-5b0541d429e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc", "name": "network-vif-plugged", "status": "completed", "tag": "db1380f2-5023-4908-b975-28df4d44f376"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:53.101858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:53.114741 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5ccb67cf-033c-4b17-9cd4-60e6a3a7c06b req-bd31f813-2e6c-4806-b763-5b0541d429e6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:53.115554 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5ccb67cf-033c-4b17-9cd4-60e6a3a7c06b req-bd31f813-2e6c-4806-b763-5b0541d429e6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:53.143756 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-5ccb67cf-033c-4b17-9cd4-60e6a3a7c06b req-bd31f813-2e6c-4806-b763-5b0541d429e6 service nova] Creating event network-vif-plugged:db1380f2-5023-4908-b975-28df4d44f376 for instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc on hv-cinder-84713 Jun 24 08:48:53.149929 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-5ccb67cf-033c-4b17-9cd4-60e6a3a7c06b req-bd31f813-2e6c-4806-b763-5b0541d429e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081515 Jun 24 08:48:53.150804 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 456/916] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:48:53.896429 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aff2b61c-91eb-46b9-82ea-d98962605d80 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:53.897092 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-aff2b61c-91eb-46b9-82ea-d98962605d80 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:53.904945 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aff2b61c-91eb-46b9-82ea-d98962605d80 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:53.905393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aff2b61c-91eb-46b9-82ea-d98962605d80 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:53.906225 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aff2b61c-91eb-46b9-82ea-d98962605d80 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:53.906665 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aff2b61c-91eb-46b9-82ea-d98962605d80 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:54.050940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aff2b61c-91eb-46b9-82ea-d98962605d80 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:54.059242 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aff2b61c-91eb-46b9-82ea-d98962605d80 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1367 microversion: 2.1 time: 0.166724 Jun 24 08:48:54.059875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 461/917] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:53 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:55.078083 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-12a50693-0a82-42e9-94c1-a3c59c102ac7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:55.078885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-12a50693-0a82-42e9-94c1-a3c59c102ac7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:55.085292 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12a50693-0a82-42e9-94c1-a3c59c102ac7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:55.085771 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12a50693-0a82-42e9-94c1-a3c59c102ac7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:55.086561 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12a50693-0a82-42e9-94c1-a3c59c102ac7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:55.086997 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12a50693-0a82-42e9-94c1-a3c59c102ac7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:55.242785 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-12a50693-0a82-42e9-94c1-a3c59c102ac7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:55.254402 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-12a50693-0a82-42e9-94c1-a3c59c102ac7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1367 microversion: 2.1 time: 0.181493 Jun 24 08:48:55.255298 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 457/918] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:55 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:56.277569 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bdc8f990-714e-4a7b-a0eb-8c05bc50df0d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:56.279343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bdc8f990-714e-4a7b-a0eb-8c05bc50df0d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:56.295409 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bdc8f990-714e-4a7b-a0eb-8c05bc50df0d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:56.296108 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bdc8f990-714e-4a7b-a0eb-8c05bc50df0d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:56.297044 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bdc8f990-714e-4a7b-a0eb-8c05bc50df0d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:56.297633 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bdc8f990-714e-4a7b-a0eb-8c05bc50df0d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:56.479348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bdc8f990-714e-4a7b-a0eb-8c05bc50df0d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:56.489176 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bdc8f990-714e-4a7b-a0eb-8c05bc50df0d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1557 microversion: 2.1 time: 0.219429 Jun 24 08:48:56.491050 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 462/919] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:56 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:56.519480 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-90cddbc2-8b68-4994-b7dc-15e93a87cb40 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:56.520601 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-90cddbc2-8b68-4994-b7dc-15e93a87cb40 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:56.529018 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90cddbc2-8b68-4994-b7dc-15e93a87cb40 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:56.529727 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90cddbc2-8b68-4994-b7dc-15e93a87cb40 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:56.530505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90cddbc2-8b68-4994-b7dc-15e93a87cb40 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:56.531151 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90cddbc2-8b68-4994-b7dc-15e93a87cb40 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:56.571351 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-587581763", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825893973", "security_groups": [{"name": "tempest-secgroup-smoke-404408504"}], "block_device_mapping_v2": [{"uuid": "e01b7bce-e903-4f48-a9cd-fe56552acd93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6af235bb-9dd2-419a-b173-c8cd5b4cf745"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:56.639743 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-90cddbc2-8b68-4994-b7dc-15e93a87cb40 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124919 Jun 24 08:48:56.640652 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 458/920] 10.222.0.13 () {58 vars in 1274 bytes} [Fri Jun 24 08:48:56 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:56.701952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] validate_networks() for [('6af235bb-9dd2-419a-b173-c8cd5b4cf745', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:48:57.164677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:48:57.165940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:48:57.165940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:48:57.166314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:48:57.166756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:48:57.178561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:57.179378 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:57.180345 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:57.180769 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:57.202270 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Getting quotas for project d0b95979aebe47bc92c387de59394942. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:57.208053 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Getting quotas for user bf905723382e4372ae63d77a376982ff and project d0b95979aebe47bc92c387de59394942. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:57.272064 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:48:57.276238 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e01b7bce-e903-4f48-a9cd-fe56552acd93',volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:48:57.473226 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-01422f1f-1db0-4e0a-a663-f1e883db8d5b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.909027 Jun 24 08:48:57.474195 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 463/921] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:48:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:48:57.484890 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-040a7a3c-dccd-422d-b951-de186a6d2b2d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:57.485924 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-040a7a3c-dccd-422d-b951-de186a6d2b2d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:57.547283 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-040a7a3c-dccd-422d-b951-de186a6d2b2d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:57.554514 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-040a7a3c-dccd-422d-b951-de186a6d2b2d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1093 microversion: 2.1 time: 0.073905 Jun 24 08:48:57.555526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 459/922] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:57 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:57.847175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-a86f0fd9-9c98-4ad2-a1f8-a9859519119f req-5464e09d-6dca-42dc-9942-6144b9f96b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc", "tag": "db1380f2-5023-4908-b975-28df4d44f376"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:57.856786 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-a86f0fd9-9c98-4ad2-a1f8-a9859519119f req-5464e09d-6dca-42dc-9942-6144b9f96b7a service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:57.857385 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-a86f0fd9-9c98-4ad2-a1f8-a9859519119f req-5464e09d-6dca-42dc-9942-6144b9f96b7a service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:57.871241 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-a86f0fd9-9c98-4ad2-a1f8-a9859519119f req-5464e09d-6dca-42dc-9942-6144b9f96b7a service nova] Creating event network-changed:db1380f2-5023-4908-b975-28df4d44f376 for instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc on hv-cinder-84713 Jun 24 08:48:57.878001 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-a86f0fd9-9c98-4ad2-a1f8-a9859519119f req-5464e09d-6dca-42dc-9942-6144b9f96b7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034683 Jun 24 08:48:57.879844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 464/923] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:58.579545 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-41c0066e-d93d-49b1-86a6-d27a4fe041ce tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:58.581056 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-41c0066e-d93d-49b1-86a6-d27a4fe041ce tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:58.591260 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-41c0066e-d93d-49b1-86a6-d27a4fe041ce tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:58.592079 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-41c0066e-d93d-49b1-86a6-d27a4fe041ce tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:58.593124 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-41c0066e-d93d-49b1-86a6-d27a4fe041ce tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:58.593972 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-41c0066e-d93d-49b1-86a6-d27a4fe041ce tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:58.672815 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-41c0066e-d93d-49b1-86a6-d27a4fe041ce tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:58.680625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-41c0066e-d93d-49b1-86a6-d27a4fe041ce tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1191 microversion: 2.1 time: 0.104987 Jun 24 08:48:58.681443 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 460/924] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:58 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:59.699793 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0b467a69-e599-4948-bae1-bf8e9ab139df tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:59.701211 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0b467a69-e599-4948-bae1-bf8e9ab139df tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:59.708987 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b467a69-e599-4948-bae1-bf8e9ab139df tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:59.709602 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b467a69-e599-4948-bae1-bf8e9ab139df tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:59.710603 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b467a69-e599-4948-bae1-bf8e9ab139df tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:59.711049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b467a69-e599-4948-bae1-bf8e9ab139df tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:00.140113 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0b467a69-e599-4948-bae1-bf8e9ab139df tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:00.170888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0b467a69-e599-4948-bae1-bf8e9ab139df tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1276 microversion: 2.1 time: 0.475312 Jun 24 08:49:00.172394 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 465/925] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:59 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1276 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:01.064316 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-5b27b221-faa9-458f-b206-80593e164293 req-e64794cb-7fc3-4210-9076-d777f37d0f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109d8faf-1466-4af8-9a69-a04f371ec7d3", "tag": "54831ccd-9e3d-43d3-b0ec-2741aac6057b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:01.083290 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5b27b221-faa9-458f-b206-80593e164293 req-e64794cb-7fc3-4210-9076-d777f37d0f51 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:01.083748 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5b27b221-faa9-458f-b206-80593e164293 req-e64794cb-7fc3-4210-9076-d777f37d0f51 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:01.096515 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-5b27b221-faa9-458f-b206-80593e164293 req-e64794cb-7fc3-4210-9076-d777f37d0f51 service nova] Creating event network-changed:54831ccd-9e3d-43d3-b0ec-2741aac6057b for instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 on hv-cinder-84713 Jun 24 08:49:01.102126 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-5b27b221-faa9-458f-b206-80593e164293 req-e64794cb-7fc3-4210-9076-d777f37d0f51 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045486 Jun 24 08:49:01.102740 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 461/926] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:01.190390 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-73e25e56-bea6-44f8-ae16-e4b04886ec63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:01.191021 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-73e25e56-bea6-44f8-ae16-e4b04886ec63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:01.198326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73e25e56-bea6-44f8-ae16-e4b04886ec63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:01.198822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73e25e56-bea6-44f8-ae16-e4b04886ec63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:01.199769 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73e25e56-bea6-44f8-ae16-e4b04886ec63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:01.200119 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-73e25e56-bea6-44f8-ae16-e4b04886ec63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:01.477647 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-73e25e56-bea6-44f8-ae16-e4b04886ec63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:01.491439 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-73e25e56-bea6-44f8-ae16-e4b04886ec63 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.304810 Jun 24 08:49:01.492037 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 466/927] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:01 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:02.517479 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-70e4c87c-193f-4fc1-80ea-daafc5538b2a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:02.518897 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-70e4c87c-193f-4fc1-80ea-daafc5538b2a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:02.530261 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70e4c87c-193f-4fc1-80ea-daafc5538b2a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:02.531072 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70e4c87c-193f-4fc1-80ea-daafc5538b2a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:02.532448 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70e4c87c-193f-4fc1-80ea-daafc5538b2a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:02.533249 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70e4c87c-193f-4fc1-80ea-daafc5538b2a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:02.697479 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-70e4c87c-193f-4fc1-80ea-daafc5538b2a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:02.708208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-70e4c87c-193f-4fc1-80ea-daafc5538b2a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.196617 Jun 24 08:49:02.709078 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 462/928] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:02 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:03.725940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9eba2386-596f-4264-9386-eded16019df4 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:03.726537 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9eba2386-596f-4264-9386-eded16019df4 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:03.734360 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9eba2386-596f-4264-9386-eded16019df4 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:03.734804 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9eba2386-596f-4264-9386-eded16019df4 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:03.735562 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9eba2386-596f-4264-9386-eded16019df4 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:03.735994 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9eba2386-596f-4264-9386-eded16019df4 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:03.872250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9eba2386-596f-4264-9386-eded16019df4 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:03.879971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9eba2386-596f-4264-9386-eded16019df4 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.157893 Jun 24 08:49:03.880534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 467/929] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:03 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:04.896446 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-863582ee-7bbe-41b6-b117-8c47f510130b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:04.897097 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-863582ee-7bbe-41b6-b117-8c47f510130b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:04.903847 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-863582ee-7bbe-41b6-b117-8c47f510130b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:04.904300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-863582ee-7bbe-41b6-b117-8c47f510130b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:04.905070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-863582ee-7bbe-41b6-b117-8c47f510130b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:04.905508 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-863582ee-7bbe-41b6-b117-8c47f510130b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:05.036058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-863582ee-7bbe-41b6-b117-8c47f510130b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:05.044284 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-863582ee-7bbe-41b6-b117-8c47f510130b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.151721 Jun 24 08:49:05.044863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 463/930] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:04 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:06.062570 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e3b795f1-2830-4933-b020-8b1e8d45b635 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:06.063188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e3b795f1-2830-4933-b020-8b1e8d45b635 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:06.070155 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e3b795f1-2830-4933-b020-8b1e8d45b635 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:06.070623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e3b795f1-2830-4933-b020-8b1e8d45b635 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:06.071408 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e3b795f1-2830-4933-b020-8b1e8d45b635 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:06.071849 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e3b795f1-2830-4933-b020-8b1e8d45b635 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:06.487894 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e3b795f1-2830-4933-b020-8b1e8d45b635 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:06.495977 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e3b795f1-2830-4933-b020-8b1e8d45b635 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.437855 Jun 24 08:49:06.496593 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 468/931] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:06 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:07.514824 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a074699-7d8f-4949-aea8-aadc57fa99d1 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:07.515471 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a074699-7d8f-4949-aea8-aadc57fa99d1 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:07.521977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a074699-7d8f-4949-aea8-aadc57fa99d1 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:07.522424 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a074699-7d8f-4949-aea8-aadc57fa99d1 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:07.523196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a074699-7d8f-4949-aea8-aadc57fa99d1 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:07.523627 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a074699-7d8f-4949-aea8-aadc57fa99d1 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:07.551839 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:07.669510 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a074699-7d8f-4949-aea8-aadc57fa99d1 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:07.677132 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a074699-7d8f-4949-aea8-aadc57fa99d1 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.166319 Jun 24 08:49:07.677714 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 464/932] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:07 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:08.694791 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-78b69731-5267-4da3-bc3f-7667091d1061 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:08.696082 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-78b69731-5267-4da3-bc3f-7667091d1061 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:08.701220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:08.701905 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:08.706326 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78b69731-5267-4da3-bc3f-7667091d1061 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:08.706799 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78b69731-5267-4da3-bc3f-7667091d1061 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:08.707636 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78b69731-5267-4da3-bc3f-7667091d1061 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:08.708079 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78b69731-5267-4da3-bc3f-7667091d1061 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:08.850908 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-78b69731-5267-4da3-bc3f-7667091d1061 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:08.859322 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-78b69731-5267-4da3-bc3f-7667091d1061 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.168441 Jun 24 08:49:08.861724 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 469/933] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:08 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:09.876882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-917bf80a-3817-4958-9c07-4a4d8a1800d2 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:09.877721 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-917bf80a-3817-4958-9c07-4a4d8a1800d2 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:09.884599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-917bf80a-3817-4958-9c07-4a4d8a1800d2 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:09.885033 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-917bf80a-3817-4958-9c07-4a4d8a1800d2 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:09.886434 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-917bf80a-3817-4958-9c07-4a4d8a1800d2 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:09.887477 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-917bf80a-3817-4958-9c07-4a4d8a1800d2 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:10.097661 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-917bf80a-3817-4958-9c07-4a4d8a1800d2 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:10.109263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-917bf80a-3817-4958-9c07-4a4d8a1800d2 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.236101 Jun 24 08:49:10.109882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 465/934] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:09 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:11.036133 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-6348ebaa-2047-470d-83ab-88a9b5bfe75e req-27c3471a-cf2f-4d17-aa9e-ec919b6ef287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109d8faf-1466-4af8-9a69-a04f371ec7d3", "name": "network-vif-plugged", "status": "completed", "tag": "54831ccd-9e3d-43d3-b0ec-2741aac6057b"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:11.065720 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-6348ebaa-2047-470d-83ab-88a9b5bfe75e req-27c3471a-cf2f-4d17-aa9e-ec919b6ef287 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:11.068743 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-6348ebaa-2047-470d-83ab-88a9b5bfe75e req-27c3471a-cf2f-4d17-aa9e-ec919b6ef287 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:11.084876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-6348ebaa-2047-470d-83ab-88a9b5bfe75e req-27c3471a-cf2f-4d17-aa9e-ec919b6ef287 service nova] Creating event network-vif-plugged:54831ccd-9e3d-43d3-b0ec-2741aac6057b for instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 on hv-cinder-84713 Jun 24 08:49:11.091758 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-6348ebaa-2047-470d-83ab-88a9b5bfe75e req-27c3471a-cf2f-4d17-aa9e-ec919b6ef287 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059666 Jun 24 08:49:11.093037 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 470/935] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:11.127414 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-679304d4-8500-4210-b940-99ce7d15dbdb tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:11.128124 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-679304d4-8500-4210-b940-99ce7d15dbdb tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:11.130805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:11.136307 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-679304d4-8500-4210-b940-99ce7d15dbdb tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:11.136803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-679304d4-8500-4210-b940-99ce7d15dbdb tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:11.137575 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-679304d4-8500-4210-b940-99ce7d15dbdb tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:11.138207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-679304d4-8500-4210-b940-99ce7d15dbdb tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:11.286855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-679304d4-8500-4210-b940-99ce7d15dbdb tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:11.295685 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-679304d4-8500-4210-b940-99ce7d15dbdb tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.171997 Jun 24 08:49:11.296687 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 466/936] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:11 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:12.314679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e42d442c-08a0-4fbf-a343-77b6b9755f4e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:12.315255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e42d442c-08a0-4fbf-a343-77b6b9755f4e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:12.317125 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:12.322688 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e42d442c-08a0-4fbf-a343-77b6b9755f4e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:12.323128 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e42d442c-08a0-4fbf-a343-77b6b9755f4e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:12.323891 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e42d442c-08a0-4fbf-a343-77b6b9755f4e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:12.324325 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e42d442c-08a0-4fbf-a343-77b6b9755f4e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:12.459670 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e42d442c-08a0-4fbf-a343-77b6b9755f4e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:12.467236 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e42d442c-08a0-4fbf-a343-77b6b9755f4e tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1264 microversion: 2.1 time: 0.157580 Jun 24 08:49:12.467977 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 471/937] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:12 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:13.483438 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-14ca918d-2163-4ba4-a4cf-c2f02d570890 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:13.484507 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-14ca918d-2163-4ba4-a4cf-c2f02d570890 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:13.490586 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14ca918d-2163-4ba4-a4cf-c2f02d570890 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:13.491032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14ca918d-2163-4ba4-a4cf-c2f02d570890 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:13.491809 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14ca918d-2163-4ba4-a4cf-c2f02d570890 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:13.492220 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14ca918d-2163-4ba4-a4cf-c2f02d570890 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:13.494799 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=72 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:13.638021 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-14ca918d-2163-4ba4-a4cf-c2f02d570890 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:13.646048 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-14ca918d-2163-4ba4-a4cf-c2f02d570890 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1449 microversion: 2.1 time: 0.166387 Jun 24 08:49:13.646386 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 467/938] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:13 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:13.663074 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-112941b7-7c80-42cd-90cd-d107587b12e6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:13.663659 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-112941b7-7c80-42cd-90cd-d107587b12e6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:13.671097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-112941b7-7c80-42cd-90cd-d107587b12e6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:13.671540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-112941b7-7c80-42cd-90cd-d107587b12e6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:13.672300 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-112941b7-7c80-42cd-90cd-d107587b12e6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:13.672733 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-112941b7-7c80-42cd-90cd-d107587b12e6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:13.675380 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=86 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:13.806561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-112941b7-7c80-42cd-90cd-d107587b12e6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:13.814710 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-112941b7-7c80-42cd-90cd-d107587b12e6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1449 microversion: 2.1 time: 0.155679 Jun 24 08:49:13.815281 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 472/939] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:13 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:15.811394 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-3256a3ef-c76a-495d-9707-4fb6965f34c2 req-029f4514-38d5-4471-9be9-cf9eeede3ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109d8faf-1466-4af8-9a69-a04f371ec7d3", "tag": "54831ccd-9e3d-43d3-b0ec-2741aac6057b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:15.820641 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3256a3ef-c76a-495d-9707-4fb6965f34c2 req-029f4514-38d5-4471-9be9-cf9eeede3ba0 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:15.821328 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3256a3ef-c76a-495d-9707-4fb6965f34c2 req-029f4514-38d5-4471-9be9-cf9eeede3ba0 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:15.836476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-3256a3ef-c76a-495d-9707-4fb6965f34c2 req-029f4514-38d5-4471-9be9-cf9eeede3ba0 service nova] Creating event network-changed:54831ccd-9e3d-43d3-b0ec-2741aac6057b for instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 on hv-cinder-84713 Jun 24 08:49:15.843718 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-3256a3ef-c76a-495d-9707-4fb6965f34c2 req-029f4514-38d5-4471-9be9-cf9eeede3ba0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036028 Jun 24 08:49:15.844425 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 468/940] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:49:34.389108 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ea9468c2-cfc8-4e15-8fb7-b35df67d0af5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:34.389759 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ea9468c2-cfc8-4e15-8fb7-b35df67d0af5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:34.393047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:34.393719 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=5 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:34.397610 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea9468c2-cfc8-4e15-8fb7-b35df67d0af5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.398110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea9468c2-cfc8-4e15-8fb7-b35df67d0af5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.398892 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea9468c2-cfc8-4e15-8fb7-b35df67d0af5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.399334 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea9468c2-cfc8-4e15-8fb7-b35df67d0af5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.430081 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ea9468c2-cfc8-4e15-8fb7-b35df67d0af5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc/ips" status: 200 len: 150 microversion: 2.1 time: 0.046999 Jun 24 08:49:34.431141 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 473/941] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:49:34 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:34.445383 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7699b001-b375-4149-a389-7f37c31c4b55"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:34.447165 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:34.450685 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=5 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:34.451336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=7 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:34.457578 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.458050 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.458841 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.459279 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Invalid volume: volume 7699b001-b375-4149-a389-7f37c31c4b55 is already attached to instances: 57397a13-99c7-451e-8c0a-a7c6303a7fa9 Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: POST /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc/os-volume_attachments HTTP/1.1 Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 74 Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:49:34.548532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {"volumeAttachment": {"volumeId": "7699b001-b375-4149-a389-7f37c31c4b55"}} Jun 24 08:49:34.550332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Invalid volume: volume 7699b001-b375-4149-a389-7f37c31c4b55 is already attached to instances: 57397a13-99c7-451e-8c0a-a7c6303a7fa9 Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'server_id': 'f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc', 'body': {'volumeAttachment': {'volumeId': '7699b001-b375-4149-a389-7f37c31c4b55'}}} Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7699b001-b375-4149-a389-7f37c31c4b55 is already attached to instances: 57397a13-99c7-451e-8c0a-a7c6303a7fa9 Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:34.551130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7699b001-b375-4149-a389-7f37c31c4b55 is already attached to instances: 57397a13-99c7-451e-8c0a-a7c6303a7fa9 Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:34.552562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:49:34.553887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:49:34.553887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:49:34.553887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:49:34.553887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7699b001-b375-4149-a389-7f37c31c4b55 is already attached to instances: 57397a13-99c7-451e-8c0a-a7c6303a7fa9 Jun 24 08:49:34.553887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:34.553887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 400 to user: Invalid volume: volume 7699b001-b375-4149-a389-7f37c31c4b55 is already attached to instances: 57397a13-99c7-451e-8c0a-a7c6303a7fa9 {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:49:34.553887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c05a2205-fd6e-4e6b-abba-9ddcd927e5e0 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111655 Jun 24 08:49:34.553887 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 469/942] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:49:34 2022] POST /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 08:49:34.563899 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a32f6d0f-2fcb-4e69-9283-c3d9ab76a7a6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:34.564393 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a32f6d0f-2fcb-4e69-9283-c3d9ab76a7a6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:34.570897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a32f6d0f-2fcb-4e69-9283-c3d9ab76a7a6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.571349 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a32f6d0f-2fcb-4e69-9283-c3d9ab76a7a6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.572128 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a32f6d0f-2fcb-4e69-9283-c3d9ab76a7a6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.572558 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a32f6d0f-2fcb-4e69-9283-c3d9ab76a7a6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.600430 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a32f6d0f-2fcb-4e69-9283-c3d9ab76a7a6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:49:34.709306 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a32f6d0f-2fcb-4e69-9283-c3d9ab76a7a6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 204 len: 0 microversion: 2.1 time: 0.148785 Jun 24 08:49:34.710519 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 474/943] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:49:34 2022] DELETE /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:49:34.719544 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-68638675-209e-4ac6-ae45-9e3de7318d95 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:34.720403 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-68638675-209e-4ac6-ae45-9e3de7318d95 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:34.728692 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68638675-209e-4ac6-ae45-9e3de7318d95 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.729882 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68638675-209e-4ac6-ae45-9e3de7318d95 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.731503 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68638675-209e-4ac6-ae45-9e3de7318d95 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.731938 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68638675-209e-4ac6-ae45-9e3de7318d95 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.898158 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-68638675-209e-4ac6-ae45-9e3de7318d95 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:34.907006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-68638675-209e-4ac6-ae45-9e3de7318d95 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1682 microversion: 2.1 time: 0.191453 Jun 24 08:49:34.907597 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 470/944] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:34 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:35.804854 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-262bdf04-59f7-4612-9043-a51afa87b2b8 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Action: 'create', calling method: .version_select at 0x7f0a6fe37160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-702012254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKVI8Dq04LCYOSRuYWZP9Bu9WCTa0SJlJGkPqUe84eEWbFT9gpO5uoOtRHt7lvMseAEAHbAsyFwN5WY+QlCFiO7xU3VgPybJcx4PMlPxWPxT4JzIIkZK3JEy4yMmgP/2w=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:35.819304 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-262bdf04-59f7-4612-9043-a51afa87b2b8 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Getting quotas for project 2fa7360005f4416f87703d3efb18d3e1. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:49:35.824027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-262bdf04-59f7-4612-9043-a51afa87b2b8 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Getting quotas for user c5cd4e3fa19443a885d9dcb3e4bfcf5f and project 2fa7360005f4416f87703d3efb18d3e1. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:49:35.847252 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-262bdf04-59f7-4612-9043-a51afa87b2b8 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046670 Jun 24 08:49:35.847892 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 475/945] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:49:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:35.895941 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-357058613", "imageRef": "8604a042-4bfb-47dc-841e-440fc633c58b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-702012254", "networks": [{"uuid": "37d35eef-7c65-436e-86fa-f165d2ee9cfb"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:35.924452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ab5c1052-573a-430b-bd56-64d7ea77157f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:35.925235 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ab5c1052-573a-430b-bd56-64d7ea77157f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:35.932045 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ab5c1052-573a-430b-bd56-64d7ea77157f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.932590 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ab5c1052-573a-430b-bd56-64d7ea77157f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.933369 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ab5c1052-573a-430b-bd56-64d7ea77157f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.933845 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ab5c1052-573a-430b-bd56-64d7ea77157f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.947855 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] validate_networks() for [('37d35eef-7c65-436e-86fa-f165d2ee9cfb', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:49:36.155682 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ab5c1052-573a-430b-bd56-64d7ea77157f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.163372 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ab5c1052-573a-430b-bd56-64d7ea77157f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1682 microversion: 2.1 time: 0.242780 Jun 24 08:49:36.163955 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 476/946] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:35 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:36.408224 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:49:36.408666 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:49:36.409131 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:49:36.409529 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:49:36.409976 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:49:36.419480 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:36.419920 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:36.420709 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:36.421138 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:36.437994 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Getting quotas for project 2fa7360005f4416f87703d3efb18d3e1. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:49:36.441876 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Getting quotas for user c5cd4e3fa19443a885d9dcb3e4bfcf5f and project 2fa7360005f4416f87703d3efb18d3e1. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:49:36.452406 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:49:36.454612 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8604a042-4bfb-47dc-841e-440fc633c58b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:49:36.512850 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3cedbd46-969d-43c2-811f-9fc318bbef27 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620623 Jun 24 08:49:36.513500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 471/947] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:49:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:49:36.524744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-13ad082a-dc7b-43dc-b6d4-fb762f9e67d0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:36.525361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-13ad082a-dc7b-43dc-b6d4-fb762f9e67d0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:36.599448 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-13ad082a-dc7b-43dc-b6d4-fb762f9e67d0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.615383 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-13ad082a-dc7b-43dc-b6d4-fb762f9e67d0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1257 microversion: 2.1 time: 0.094314 Jun 24 08:49:36.616041 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 477/948] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:36 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1257 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:37.181106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eea21af3-d4be-4db1-9bc7-3902108dea33 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:37.181793 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eea21af3-d4be-4db1-9bc7-3902108dea33 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:37.193950 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eea21af3-d4be-4db1-9bc7-3902108dea33 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.194287 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eea21af3-d4be-4db1-9bc7-3902108dea33 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.195076 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eea21af3-d4be-4db1-9bc7-3902108dea33 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.195519 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eea21af3-d4be-4db1-9bc7-3902108dea33 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.274459 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eea21af3-d4be-4db1-9bc7-3902108dea33 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:37.282842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eea21af3-d4be-4db1-9bc7-3902108dea33 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 200 len: 1615 microversion: 2.1 time: 0.105757 Jun 24 08:49:37.283418 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 472/949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:37 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:37.495399 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-4fbbc2b6-028e-4c2b-abdc-60cef9a7b0a9 req-15c54dc6-6ea7-413a-a362-5f54c0e59fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc", "name": "network-vif-deleted", "tag": "db1380f2-5023-4908-b975-28df4d44f376"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:37.505437 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-4fbbc2b6-028e-4c2b-abdc-60cef9a7b0a9 req-15c54dc6-6ea7-413a-a362-5f54c0e59fb4 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.505888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-4fbbc2b6-028e-4c2b-abdc-60cef9a7b0a9 req-15c54dc6-6ea7-413a-a362-5f54c0e59fb4 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.519599 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-4fbbc2b6-028e-4c2b-abdc-60cef9a7b0a9 req-15c54dc6-6ea7-413a-a362-5f54c0e59fb4 service nova] Creating event network-vif-deleted:db1380f2-5023-4908-b975-28df4d44f376 for instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc on hv-cinder-84713 Jun 24 08:49:37.525860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-4fbbc2b6-028e-4c2b-abdc-60cef9a7b0a9 req-15c54dc6-6ea7-413a-a362-5f54c0e59fb4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034054 Jun 24 08:49:37.532233 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 478/950] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:37.632957 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4c3333df-e9de-49da-ae65-ecb634ec62b4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:37.633568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4c3333df-e9de-49da-ae65-ecb634ec62b4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:37.640724 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c3333df-e9de-49da-ae65-ecb634ec62b4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.641505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c3333df-e9de-49da-ae65-ecb634ec62b4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.642457 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c3333df-e9de-49da-ae65-ecb634ec62b4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.642928 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c3333df-e9de-49da-ae65-ecb634ec62b4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.751880 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4c3333df-e9de-49da-ae65-ecb634ec62b4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:37.762780 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4c3333df-e9de-49da-ae65-ecb634ec62b4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1317 microversion: 2.1 time: 0.134097 Jun 24 08:49:37.763847 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 473/951] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:37 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:38.304641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:38.306437 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:38.318227 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:38.320047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:38.322128 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:38.323478 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:38.341489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc HTTP/1.1 Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:49:38.343273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:49:38.344789 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc'} Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:49:38.346071 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:49:38.347301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:49:38.355277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:49:38.356713 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-468fe97a-9170-4118-9263-915ef51349a3 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 404 len: 111 microversion: 2.1 time: 0.059755 Jun 24 08:49:38.358032 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 479/952] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:38 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:49:38.376693 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aeb6df6d-4e48-4c42-b96d-4a4c1fb3da59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '.version_select at 0x7f0a7c7ef0d0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:38.399813 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aeb6df6d-4e48-4c42-b96d-4a4c1fb3da59 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887298264" status: 202 len: 0 microversion: 2.1 time: 0.037127 Jun 24 08:49:38.403907 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 474/953] 10.222.0.13 () {58 vars in 1220 bytes} [Fri Jun 24 08:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887298264 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:49:38.784434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-057114fa-a988-4cfc-837a-a5076b6110d9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:38.785843 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-057114fa-a988-4cfc-837a-a5076b6110d9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:38.800563 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-057114fa-a988-4cfc-837a-a5076b6110d9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:38.801214 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-057114fa-a988-4cfc-837a-a5076b6110d9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:38.802492 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-057114fa-a988-4cfc-837a-a5076b6110d9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:38.803126 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-057114fa-a988-4cfc-837a-a5076b6110d9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:39.319178 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-057114fa-a988-4cfc-837a-a5076b6110d9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:39.327432 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-057114fa-a988-4cfc-837a-a5076b6110d9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.548631 Jun 24 08:49:39.328008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 480/954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:38 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:40.132011 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-6c9e0a20-d52c-46f1-95ee-140c8b60789b req-8ff0cb9f-25e2-41a4-8ce6-63999cdc28da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3aa531-5c49-4aa6-908e-f98f9cedbda4", "tag": "847e9d65-5fa2-49be-983e-9cbfe98fb601"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:40.159972 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-6c9e0a20-d52c-46f1-95ee-140c8b60789b req-8ff0cb9f-25e2-41a4-8ce6-63999cdc28da service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.160766 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-6c9e0a20-d52c-46f1-95ee-140c8b60789b req-8ff0cb9f-25e2-41a4-8ce6-63999cdc28da service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.169395 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-33bb0a35-5473-4467-9906-9a037b753ec2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:40.170561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-33bb0a35-5473-4467-9906-9a037b753ec2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:40.177888 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-6c9e0a20-d52c-46f1-95ee-140c8b60789b req-8ff0cb9f-25e2-41a4-8ce6-63999cdc28da service nova] Creating event network-changed:847e9d65-5fa2-49be-983e-9cbfe98fb601 for instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 on hv-cinder-84713 Jun 24 08:49:40.184831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-33bb0a35-5473-4467-9906-9a037b753ec2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.185272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-33bb0a35-5473-4467-9906-9a037b753ec2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.186104 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-33bb0a35-5473-4467-9906-9a037b753ec2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.186546 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-33bb0a35-5473-4467-9906-9a037b753ec2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.188607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-6c9e0a20-d52c-46f1-95ee-140c8b60789b req-8ff0cb9f-25e2-41a4-8ce6-63999cdc28da service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059303 Jun 24 08:49:40.190223 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 475/955] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:40.302141 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-33bb0a35-5473-4467-9906-9a037b753ec2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lazy-loading 'services' on Instance uuid 57397a13-99c7-451e-8c0a-a7c6303a7fa9 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:49:40.352072 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4734cbd7-37e6-475b-a56c-80abadbe7203 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:40.353090 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4734cbd7-37e6-475b-a56c-80abadbe7203 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:40.363727 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4734cbd7-37e6-475b-a56c-80abadbe7203 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.364377 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4734cbd7-37e6-475b-a56c-80abadbe7203 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.365353 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4734cbd7-37e6-475b-a56c-80abadbe7203 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.375665 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4734cbd7-37e6-475b-a56c-80abadbe7203 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.412476 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-33bb0a35-5473-4467-9906-9a037b753ec2 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments/7699b001-b375-4149-a389-7f37c31c4b55" status: 202 len: 0 microversion: 2.1 time: 0.251284 Jun 24 08:49:40.413208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 481/956] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:49:40 2022] DELETE /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments/7699b001-b375-4149-a389-7f37c31c4b55 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:49:40.432937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f2b0f09d-20bb-4baf-a0eb-1349ccc94eef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:40.434498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f2b0f09d-20bb-4baf-a0eb-1349ccc94eef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:40.442270 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2b0f09d-20bb-4baf-a0eb-1349ccc94eef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.443072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2b0f09d-20bb-4baf-a0eb-1349ccc94eef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.444108 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2b0f09d-20bb-4baf-a0eb-1349ccc94eef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.444756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2b0f09d-20bb-4baf-a0eb-1349ccc94eef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.518116 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f2b0f09d-20bb-4baf-a0eb-1349ccc94eef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098633 Jun 24 08:49:40.522441 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 482/957] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:49:40 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:40.606765 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4734cbd7-37e6-475b-a56c-80abadbe7203 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:40.614775 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4734cbd7-37e6-475b-a56c-80abadbe7203 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.273159 Jun 24 08:49:40.627106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 476/958] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:40 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:41.530857 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7223c227-f3ef-4f47-9023-fc664aa9d931 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:41.531457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7223c227-f3ef-4f47-9023-fc664aa9d931 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:41.538041 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7223c227-f3ef-4f47-9023-fc664aa9d931 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.538560 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7223c227-f3ef-4f47-9023-fc664aa9d931 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.539396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7223c227-f3ef-4f47-9023-fc664aa9d931 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.539831 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7223c227-f3ef-4f47-9023-fc664aa9d931 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.572027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7223c227-f3ef-4f47-9023-fc664aa9d931 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Jun 24 08:49:41.577019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 483/959] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:49:41 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:41.634457 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5323db09-3232-43be-bb7e-7c4fba13e30a tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:41.634978 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5323db09-3232-43be-bb7e-7c4fba13e30a tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:41.642874 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5323db09-3232-43be-bb7e-7c4fba13e30a tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.643758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5323db09-3232-43be-bb7e-7c4fba13e30a tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.644654 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5323db09-3232-43be-bb7e-7c4fba13e30a tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.645096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5323db09-3232-43be-bb7e-7c4fba13e30a tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.804360 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5323db09-3232-43be-bb7e-7c4fba13e30a tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:41.814296 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5323db09-3232-43be-bb7e-7c4fba13e30a tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.183661 Jun 24 08:49:41.814884 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 477/960] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:41 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:42.585089 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-53fe8a06-01de-4211-98f6-57aaf743fa82 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:42.586053 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-53fe8a06-01de-4211-98f6-57aaf743fa82 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:42.592828 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-53fe8a06-01de-4211-98f6-57aaf743fa82 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.593565 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-53fe8a06-01de-4211-98f6-57aaf743fa82 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.594532 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-53fe8a06-01de-4211-98f6-57aaf743fa82 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.595130 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-53fe8a06-01de-4211-98f6-57aaf743fa82 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.627992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-53fe8a06-01de-4211-98f6-57aaf743fa82 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047190 Jun 24 08:49:42.628487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 484/961] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:49:42 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:42.831515 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e47174e1-84ec-43c8-8aff-bfafd44a5bc1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:42.833086 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e47174e1-84ec-43c8-8aff-bfafd44a5bc1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:42.841006 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e47174e1-84ec-43c8-8aff-bfafd44a5bc1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.841527 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e47174e1-84ec-43c8-8aff-bfafd44a5bc1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.842417 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e47174e1-84ec-43c8-8aff-bfafd44a5bc1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.843541 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e47174e1-84ec-43c8-8aff-bfafd44a5bc1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.986778 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e47174e1-84ec-43c8-8aff-bfafd44a5bc1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:42.997265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e47174e1-84ec-43c8-8aff-bfafd44a5bc1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.169693 Jun 24 08:49:42.997940 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 478/962] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:42 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:43.642167 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8c02f914-f1ed-42f6-a897-38939441a49d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:43.646511 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8c02f914-f1ed-42f6-a897-38939441a49d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:43.654123 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c02f914-f1ed-42f6-a897-38939441a49d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:43.654835 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c02f914-f1ed-42f6-a897-38939441a49d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:43.655623 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c02f914-f1ed-42f6-a897-38939441a49d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:43.656089 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c02f914-f1ed-42f6-a897-38939441a49d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:43.689769 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8c02f914-f1ed-42f6-a897-38939441a49d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051763 Jun 24 08:49:43.694652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 485/963] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:49:43 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:44.016737 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-97aa5c77-290d-4fbe-8250-00a35b8c0c96 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:44.017632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-97aa5c77-290d-4fbe-8250-00a35b8c0c96 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:44.029668 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97aa5c77-290d-4fbe-8250-00a35b8c0c96 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.030142 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97aa5c77-290d-4fbe-8250-00a35b8c0c96 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.030934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97aa5c77-290d-4fbe-8250-00a35b8c0c96 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.031370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97aa5c77-290d-4fbe-8250-00a35b8c0c96 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.176532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97aa5c77-290d-4fbe-8250-00a35b8c0c96 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:44.186042 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-97aa5c77-290d-4fbe-8250-00a35b8c0c96 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.173219 Jun 24 08:49:44.186904 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 479/964] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:44 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:44.703032 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f1d775d0-0c92-4f03-b792-0d592d2fa3d8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:44.703964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f1d775d0-0c92-4f03-b792-0d592d2fa3d8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:44.710918 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1d775d0-0c92-4f03-b792-0d592d2fa3d8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.711465 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1d775d0-0c92-4f03-b792-0d592d2fa3d8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.712294 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1d775d0-0c92-4f03-b792-0d592d2fa3d8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.712734 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1d775d0-0c92-4f03-b792-0d592d2fa3d8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.746964 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f1d775d0-0c92-4f03-b792-0d592d2fa3d8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047771 Jun 24 08:49:44.747758 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 486/965] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:49:44 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:45.204970 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b2574650-e828-4de6-8f23-334c0b74fe60 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:45.207339 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b2574650-e828-4de6-8f23-334c0b74fe60 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:45.215531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2574650-e828-4de6-8f23-334c0b74fe60 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:45.215963 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2574650-e828-4de6-8f23-334c0b74fe60 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:45.216728 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2574650-e828-4de6-8f23-334c0b74fe60 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:45.217157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2574650-e828-4de6-8f23-334c0b74fe60 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:45.363464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2574650-e828-4de6-8f23-334c0b74fe60 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:45.372026 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b2574650-e828-4de6-8f23-334c0b74fe60 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.172277 Jun 24 08:49:45.373015 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 480/966] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:45 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:45.758865 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d96b6450-9bdf-4dd1-9c27-f62b33dfb16e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:45.759889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d96b6450-9bdf-4dd1-9c27-f62b33dfb16e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:45.766977 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d96b6450-9bdf-4dd1-9c27-f62b33dfb16e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:45.767519 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d96b6450-9bdf-4dd1-9c27-f62b33dfb16e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:45.768365 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d96b6450-9bdf-4dd1-9c27-f62b33dfb16e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:45.768878 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d96b6450-9bdf-4dd1-9c27-f62b33dfb16e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:45.802605 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d96b6450-9bdf-4dd1-9c27-f62b33dfb16e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048206 Jun 24 08:49:45.803172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 487/967] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:49:45 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:46.389504 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b30e25ba-de85-4f4d-b62c-b0e01cb025c0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:46.390129 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b30e25ba-de85-4f4d-b62c-b0e01cb025c0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:46.396675 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b30e25ba-de85-4f4d-b62c-b0e01cb025c0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.397147 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b30e25ba-de85-4f4d-b62c-b0e01cb025c0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.398037 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b30e25ba-de85-4f4d-b62c-b0e01cb025c0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.398594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b30e25ba-de85-4f4d-b62c-b0e01cb025c0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.428587 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:46.448360 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:46.532297 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b30e25ba-de85-4f4d-b62c-b0e01cb025c0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:46.539845 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b30e25ba-de85-4f4d-b62c-b0e01cb025c0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.154426 Jun 24 08:49:46.540410 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 481/968] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:46 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:46.814629 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-40806428-bf61-4774-9a2e-4a0bf05dae4f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:46.815589 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-40806428-bf61-4774-9a2e-4a0bf05dae4f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:46.820992 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:46.824664 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-40806428-bf61-4774-9a2e-4a0bf05dae4f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.825116 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-40806428-bf61-4774-9a2e-4a0bf05dae4f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.825949 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-40806428-bf61-4774-9a2e-4a0bf05dae4f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.826392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-40806428-bf61-4774-9a2e-4a0bf05dae4f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.863996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-40806428-bf61-4774-9a2e-4a0bf05dae4f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053336 Jun 24 08:49:46.864659 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 488/969] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:49:46 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:47.556440 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a5552bb-2ce2-4d52-a7bf-a25a25630a4c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:47.557111 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a5552bb-2ce2-4d52-a7bf-a25a25630a4c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:47.565066 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a5552bb-2ce2-4d52-a7bf-a25a25630a4c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.565397 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a5552bb-2ce2-4d52-a7bf-a25a25630a4c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.566258 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a5552bb-2ce2-4d52-a7bf-a25a25630a4c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.566729 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a5552bb-2ce2-4d52-a7bf-a25a25630a4c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.876711 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0b1534c1-222b-4d8a-8e71-a75d3a68012f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:47.877706 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0b1534c1-222b-4d8a-8e71-a75d3a68012f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:47.884884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b1534c1-222b-4d8a-8e71-a75d3a68012f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.885328 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b1534c1-222b-4d8a-8e71-a75d3a68012f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.886130 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b1534c1-222b-4d8a-8e71-a75d3a68012f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.886619 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b1534c1-222b-4d8a-8e71-a75d3a68012f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.926335 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0b1534c1-222b-4d8a-8e71-a75d3a68012f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053785 Jun 24 08:49:47.927156 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 489/970] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:49:47 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:49:47.987890 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-27dba1cf-983a-40b8-a770-fb0036099683 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:47.988389 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-27dba1cf-983a-40b8-a770-fb0036099683 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:47.994442 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-27dba1cf-983a-40b8-a770-fb0036099683 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.995525 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-27dba1cf-983a-40b8-a770-fb0036099683 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.996232 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-27dba1cf-983a-40b8-a770-fb0036099683 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.996659 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-27dba1cf-983a-40b8-a770-fb0036099683 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.022000 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-27dba1cf-983a-40b8-a770-fb0036099683 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:49:48.024852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:48.104599 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-27dba1cf-983a-40b8-a770-fb0036099683 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 204 len: 0 microversion: 2.1 time: 0.120207 Jun 24 08:49:48.105622 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 490/971] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:49:47 2022] DELETE /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:49:48.115350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-472997d2-e0e0-4e84-93b5-d1dc656125ec tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:48.116205 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-472997d2-e0e0-4e84-93b5-d1dc656125ec tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:48.123134 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-472997d2-e0e0-4e84-93b5-d1dc656125ec tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:48.123583 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-472997d2-e0e0-4e84-93b5-d1dc656125ec tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.124347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-472997d2-e0e0-4e84-93b5-d1dc656125ec tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:48.124778 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-472997d2-e0e0-4e84-93b5-d1dc656125ec tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.137205 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a5552bb-2ce2-4d52-a7bf-a25a25630a4c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.146284 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a5552bb-2ce2-4d52-a7bf-a25a25630a4c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.593271 Jun 24 08:49:48.146863 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 482/972] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:47 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:48.282260 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-472997d2-e0e0-4e84-93b5-d1dc656125ec tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.290068 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-472997d2-e0e0-4e84-93b5-d1dc656125ec tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1680 microversion: 2.1 time: 0.179334 Jun 24 08:49:48.290641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 491/973] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:48 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:49.163869 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-895a3b6b-9050-4857-9f06-87ba5110895e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:49.164457 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-895a3b6b-9050-4857-9f06-87ba5110895e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:49.171773 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-895a3b6b-9050-4857-9f06-87ba5110895e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.172241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-895a3b6b-9050-4857-9f06-87ba5110895e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.173009 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-895a3b6b-9050-4857-9f06-87ba5110895e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.173470 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-895a3b6b-9050-4857-9f06-87ba5110895e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.308467 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f596b332-89d7-4d3c-b6a1-0f5eabb3fe77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:49.310073 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f596b332-89d7-4d3c-b6a1-0f5eabb3fe77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:49.320019 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f596b332-89d7-4d3c-b6a1-0f5eabb3fe77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.321043 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f596b332-89d7-4d3c-b6a1-0f5eabb3fe77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.322219 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-895a3b6b-9050-4857-9f06-87ba5110895e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.322457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f596b332-89d7-4d3c-b6a1-0f5eabb3fe77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.323217 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f596b332-89d7-4d3c-b6a1-0f5eabb3fe77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.336590 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-895a3b6b-9050-4857-9f06-87ba5110895e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.176220 Jun 24 08:49:49.337532 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 483/974] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:49 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:49.649550 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f596b332-89d7-4d3c-b6a1-0f5eabb3fe77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.657988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f596b332-89d7-4d3c-b6a1-0f5eabb3fe77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1680 microversion: 2.1 time: 0.353579 Jun 24 08:49:49.658572 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 492/975] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:49 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1680 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:50.355840 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e3570e95-6b08-4758-be4a-6f5047a2d5af tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:50.356388 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e3570e95-6b08-4758-be4a-6f5047a2d5af tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:50.363009 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e3570e95-6b08-4758-be4a-6f5047a2d5af tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.363455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e3570e95-6b08-4758-be4a-6f5047a2d5af tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.364262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e3570e95-6b08-4758-be4a-6f5047a2d5af tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.364699 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e3570e95-6b08-4758-be4a-6f5047a2d5af tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.504582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e3570e95-6b08-4758-be4a-6f5047a2d5af tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:50.513383 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e3570e95-6b08-4758-be4a-6f5047a2d5af tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.161783 Jun 24 08:49:50.513980 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 484/976] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:50 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:50.675452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9d2d1be5-aa9f-409b-8056-24781e913ace tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:50.676054 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9d2d1be5-aa9f-409b-8056-24781e913ace tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:50.683491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d2d1be5-aa9f-409b-8056-24781e913ace tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.684047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d2d1be5-aa9f-409b-8056-24781e913ace tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.684828 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d2d1be5-aa9f-409b-8056-24781e913ace tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.685254 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d2d1be5-aa9f-409b-8056-24781e913ace tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.914403 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9d2d1be5-aa9f-409b-8056-24781e913ace tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:50.923876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9d2d1be5-aa9f-409b-8056-24781e913ace tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1680 microversion: 2.1 time: 0.252231 Jun 24 08:49:50.924482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 493/977] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:50 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1680 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:51.500228 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-02e46ed8-aaa9-4f67-9899-d1d5108569e3 req-8fd20043-c0f8-4f1c-bd0d-30abbdb5fbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57397a13-99c7-451e-8c0a-a7c6303a7fa9", "name": "network-vif-deleted", "tag": "9c96470b-899f-45c4-b463-69a3cf1070d2"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:51.509607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-02e46ed8-aaa9-4f67-9899-d1d5108569e3 req-8fd20043-c0f8-4f1c-bd0d-30abbdb5fbf6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.510081 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-02e46ed8-aaa9-4f67-9899-d1d5108569e3 req-8fd20043-c0f8-4f1c-bd0d-30abbdb5fbf6 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.522927 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-02e46ed8-aaa9-4f67-9899-d1d5108569e3 req-8fd20043-c0f8-4f1c-bd0d-30abbdb5fbf6 service nova] Creating event network-vif-deleted:9c96470b-899f-45c4-b463-69a3cf1070d2 for instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 on hv-cinder-84713 Jun 24 08:49:51.531332 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b6308d22-16c5-4159-926c-6abc0eccfc4f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:51.532090 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b6308d22-16c5-4159-926c-6abc0eccfc4f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:51.532249 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-02e46ed8-aaa9-4f67-9899-d1d5108569e3 req-8fd20043-c0f8-4f1c-bd0d-30abbdb5fbf6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035647 Jun 24 08:49:51.535004 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 485/978] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:51.545242 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b6308d22-16c5-4159-926c-6abc0eccfc4f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.545713 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b6308d22-16c5-4159-926c-6abc0eccfc4f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.546498 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b6308d22-16c5-4159-926c-6abc0eccfc4f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.547053 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b6308d22-16c5-4159-926c-6abc0eccfc4f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.737972 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b6308d22-16c5-4159-926c-6abc0eccfc4f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:51.750376 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b6308d22-16c5-4159-926c-6abc0eccfc4f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.224368 Jun 24 08:49:51.751691 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 494/979] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:51 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:51.942216 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:51.943015 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:51.950441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.950811 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.951588 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.952020 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.989075 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.989832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.990329 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lazy-loading 'fault' on Instance uuid 57397a13-99c7-451e-8c0a-a7c6303a7fa9 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:49:52.051597 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.066284 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3f94d770-7093-46bf-ae99-63aa03b59556 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 200 len: 1331 microversion: 2.1 time: 0.127917 Jun 24 08:49:52.067207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 486/980] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:51 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:52.769055 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0442567c-4e38-4f34-ab5a-9562cdf1cdf6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:52.769664 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0442567c-4e38-4f34-ab5a-9562cdf1cdf6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:52.777333 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0442567c-4e38-4f34-ab5a-9562cdf1cdf6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:52.777815 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0442567c-4e38-4f34-ab5a-9562cdf1cdf6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:52.778605 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0442567c-4e38-4f34-ab5a-9562cdf1cdf6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:52.779032 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0442567c-4e38-4f34-ab5a-9562cdf1cdf6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:52.908622 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0442567c-4e38-4f34-ab5a-9562cdf1cdf6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.916993 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0442567c-4e38-4f34-ab5a-9562cdf1cdf6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.151426 Jun 24 08:49:52.917566 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 495/981] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:52 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:53.085761 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:53.086380 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:53.093027 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.093485 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.094290 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.094730 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.108957 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 HTTP/1.1 Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:49:53.110568 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:49:53.112237 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '57397a13-99c7-451e-8c0a-a7c6303a7fa9'} Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:49:53.113058 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:49:53.114355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:49:53.115479 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:49:53.115479 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d574e50-8723-4036-836f-b6a67d183ac5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 404 len: 111 microversion: 2.1 time: 0.030144 Jun 24 08:49:53.115479 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 487/982] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:53 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:49:53.121838 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-52aa4d59-f1f8-45dd-aa88-d587182178db tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '.version_select at 0x7f0a6fdf15e0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:53.141191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-52aa4d59-f1f8-45dd-aa88-d587182178db tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764160074" status: 202 len: 0 microversion: 2.1 time: 0.023862 Jun 24 08:49:53.141830 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 496/983] 10.222.0.13 () {58 vars in 1220 bytes} [Fri Jun 24 08:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764160074 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:49:53.281104 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-c06827ff-15de-4f54-8c77-bd8804f16727 req-ede5c863-40da-479b-8d5d-a0fff37ac810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3aa531-5c49-4aa6-908e-f98f9cedbda4", "name": "network-vif-plugged", "status": "completed", "tag": "847e9d65-5fa2-49be-983e-9cbfe98fb601"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:53.290988 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-c06827ff-15de-4f54-8c77-bd8804f16727 req-ede5c863-40da-479b-8d5d-a0fff37ac810 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.292603 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-c06827ff-15de-4f54-8c77-bd8804f16727 req-ede5c863-40da-479b-8d5d-a0fff37ac810 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.306659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-c06827ff-15de-4f54-8c77-bd8804f16727 req-ede5c863-40da-479b-8d5d-a0fff37ac810 service nova] Creating event network-vif-plugged:847e9d65-5fa2-49be-983e-9cbfe98fb601 for instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 on hv-cinder-84713 Jun 24 08:49:53.326832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-c06827ff-15de-4f54-8c77-bd8804f16727 req-ede5c863-40da-479b-8d5d-a0fff37ac810 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050255 Jun 24 08:49:53.332950 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 488/984] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:53.894647 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-24da0b4b-d881-4677-92d5-46c721cadf68 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: .version_select at 0x7f0a6feb90d0>, body: {"keypair": {"name": "tempest-keypair-519853108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIleyNpf4IsZRlHq/5BtGZ39BqJs+rg1YETIBb4BpvFgkEdnblfP3htmWf9dVMbeXB6CmmJ0nPTxByqJ+xbMB/eFl3aX8W9/621nQ2umZqehE++jhsev2AgFis7R0l77Zg=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:53.912796 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-24da0b4b-d881-4677-92d5-46c721cadf68 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for project 7787ee132e9e4e23b1407718fb366406. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:49:53.917592 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-24da0b4b-d881-4677-92d5-46c721cadf68 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for user 8d15a76041274e7381087bd21eb674c9 and project 7787ee132e9e4e23b1407718fb366406. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:49:53.935118 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6bd9e1e4-c504-41be-a09e-0e68f3a31bb3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:53.936005 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6bd9e1e4-c504-41be-a09e-0e68f3a31bb3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:53.943575 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bd9e1e4-c504-41be-a09e-0e68f3a31bb3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.944288 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bd9e1e4-c504-41be-a09e-0e68f3a31bb3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.945090 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bd9e1e4-c504-41be-a09e-0e68f3a31bb3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.945244 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-24da0b4b-d881-4677-92d5-46c721cadf68 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055613 Jun 24 08:49:53.945506 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bd9e1e4-c504-41be-a09e-0e68f3a31bb3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.945860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 497/985] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:49:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:53.969079 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:54.114686 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6bd9e1e4-c504-41be-a09e-0e68f3a31bb3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:54.131944 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6bd9e1e4-c504-41be-a09e-0e68f3a31bb3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1357 microversion: 2.1 time: 0.201601 Jun 24 08:49:54.132833 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 489/986] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:53 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:55.159117 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-54574f30-7a5d-40a8-b212-156aeeb68e85 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:55.160538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-54574f30-7a5d-40a8-b212-156aeeb68e85 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:55.173455 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-54574f30-7a5d-40a8-b212-156aeeb68e85 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.173945 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-54574f30-7a5d-40a8-b212-156aeeb68e85 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.174750 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-54574f30-7a5d-40a8-b212-156aeeb68e85 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.175194 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-54574f30-7a5d-40a8-b212-156aeeb68e85 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.332097 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-54574f30-7a5d-40a8-b212-156aeeb68e85 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.342105 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-54574f30-7a5d-40a8-b212-156aeeb68e85 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1546 microversion: 2.1 time: 0.192329 Jun 24 08:49:55.342983 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 498/987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:55 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1546 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:55.366199 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb1218d6-656d-48aa-b806-b2d014cfe4ac tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:55.366199 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bb1218d6-656d-48aa-b806-b2d014cfe4ac tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:55.372048 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb1218d6-656d-48aa-b806-b2d014cfe4ac tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.372498 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb1218d6-656d-48aa-b806-b2d014cfe4ac tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.373275 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb1218d6-656d-48aa-b806-b2d014cfe4ac tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.373804 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb1218d6-656d-48aa-b806-b2d014cfe4ac tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.477800 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-788452197", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f76c266-a8af-466b-8b61-0e931014df30"}], "security_groups": [{"name": "tempest-securitygroup--502684419"}], "key_name": "tempest-keypair-519853108", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:55.526670 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bb1218d6-656d-48aa-b806-b2d014cfe4ac tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.535538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bb1218d6-656d-48aa-b806-b2d014cfe4ac tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1546 microversion: 2.1 time: 0.176456 Jun 24 08:49:55.536110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 490/988] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:55 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:55.557805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:55.561577 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.562452 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Searching by: {'deleted': False, 'project_id': '2fa7360005f4416f87703d3efb18d3e1'} {{(pid=124380) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 08:49:55.571262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.571704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.572521 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.572975 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.597951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] validate_networks() for [('0f76c266-a8af-466b-8b61-0e931014df30', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:49:55.672904 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.multi_cell_list [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124380) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 08:49:55.780333 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-94cf8697-441b-485c-ba9f-c0d3b8532303 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.227155 Jun 24 08:49:55.780979 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 491/989] 10.222.0.13 () {58 vars in 1124 bytes} [Fri Jun 24 08:49:55 2022] GET /compute/v2.1/servers => generated 342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:49:55.792988 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a2d99725-e7ce-4f03-b3f4-8f8893aa1fb5 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:55.793805 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a2d99725-e7ce-4f03-b3f4-8f8893aa1fb5 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:55.800176 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2d99725-e7ce-4f03-b3f4-8f8893aa1fb5 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.800641 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2d99725-e7ce-4f03-b3f4-8f8893aa1fb5 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.801544 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2d99725-e7ce-4f03-b3f4-8f8893aa1fb5 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.802069 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2d99725-e7ce-4f03-b3f4-8f8893aa1fb5 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:56.042651 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a2d99725-e7ce-4f03-b3f4-8f8893aa1fb5 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.050484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a2d99725-e7ce-4f03-b3f4-8f8893aa1fb5 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1546 microversion: 2.1 time: 0.261990 Jun 24 08:49:56.051061 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 492/990] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:55 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1546 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:56.105944 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:49:56.106371 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:49:56.106903 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:49:56.107418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:49:56.107881 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:49:56.117901 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:56.118343 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:56.119147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:56.121192 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:56.140614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for project 7787ee132e9e4e23b1407718fb366406. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:49:56.145379 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for user 8d15a76041274e7381087bd21eb674c9 and project 7787ee132e9e4e23b1407718fb366406. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:49:56.148703 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:56.165737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:49:56.168933 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:49:56.228438 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-78587f05-cce8-48e8-ba5a-4d1e3db97e18 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.759314 Jun 24 08:49:56.237654 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 499/991] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:49:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:49:56.245261 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e3f89701-abcd-4367-a669-984dfbe4cdbf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:56.246183 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e3f89701-abcd-4367-a669-984dfbe4cdbf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:56.320489 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e3f89701-abcd-4367-a669-984dfbe4cdbf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.329806 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e3f89701-abcd-4367-a669-984dfbe4cdbf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1240 microversion: 2.1 time: 0.090784 Jun 24 08:49:56.330637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 493/992] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:56 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:57.348168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bc145b5d-4073-4928-b74a-914a95382f1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:57.348792 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bc145b5d-4073-4928-b74a-914a95382f1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:57.365735 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc145b5d-4073-4928-b74a-914a95382f1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.367065 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc145b5d-4073-4928-b74a-914a95382f1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:57.368030 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc145b5d-4073-4928-b74a-914a95382f1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.368635 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc145b5d-4073-4928-b74a-914a95382f1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:57.448210 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bc145b5d-4073-4928-b74a-914a95382f1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:57.455888 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bc145b5d-4073-4928-b74a-914a95382f1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1300 microversion: 2.1 time: 0.112128 Jun 24 08:49:57.456468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 500/993] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:57 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:57.718798 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d9a30f95-4078-459b-a486-984aab9fce58 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:57.719920 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d9a30f95-4078-459b-a486-984aab9fce58 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:57.728592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9a30f95-4078-459b-a486-984aab9fce58 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.729372 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9a30f95-4078-459b-a486-984aab9fce58 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:57.729998 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9a30f95-4078-459b-a486-984aab9fce58 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.730431 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9a30f95-4078-459b-a486-984aab9fce58 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:58.037778 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d9a30f95-4078-459b-a486-984aab9fce58 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "POST /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323183 Jun 24 08:49:58.038395 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 494/994] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:49:57 2022] POST /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:58.473951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-04ffa0a3-8398-464a-894b-d22aa179d557 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:58.474572 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-04ffa0a3-8398-464a-894b-d22aa179d557 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:58.482423 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04ffa0a3-8398-464a-894b-d22aa179d557 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:58.482860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04ffa0a3-8398-464a-894b-d22aa179d557 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:58.483647 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04ffa0a3-8398-464a-894b-d22aa179d557 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:58.484083 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04ffa0a3-8398-464a-894b-d22aa179d557 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:58.711322 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-04ffa0a3-8398-464a-894b-d22aa179d557 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:58.723331 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-04ffa0a3-8398-464a-894b-d22aa179d557 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1365 microversion: 2.1 time: 0.253349 Jun 24 08:49:58.723918 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 501/995] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:58 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:59.001707 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-63dc2d0f-9db0-47e9-9620-fbee72f0b1e7 req-83452e0e-84dd-4a74-843b-6a00231c0920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c8e6a0-6446-4747-964e-09d614c2eabd", "tag": "b123be3e-8a3c-4449-9443-f48c362c9866"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:59.018801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-63dc2d0f-9db0-47e9-9620-fbee72f0b1e7 req-83452e0e-84dd-4a74-843b-6a00231c0920 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:59.019477 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-63dc2d0f-9db0-47e9-9620-fbee72f0b1e7 req-83452e0e-84dd-4a74-843b-6a00231c0920 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:59.035134 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-63dc2d0f-9db0-47e9-9620-fbee72f0b1e7 req-83452e0e-84dd-4a74-843b-6a00231c0920 service nova] Creating event network-changed:b123be3e-8a3c-4449-9443-f48c362c9866 for instance 99c8e6a0-6446-4747-964e-09d614c2eabd on hv-cinder-84713 Jun 24 08:49:59.041823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-63dc2d0f-9db0-47e9-9620-fbee72f0b1e7 req-83452e0e-84dd-4a74-843b-6a00231c0920 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044698 Jun 24 08:49:59.042703 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 495/996] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:59.740850 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f52c5219-09da-4d17-817b-18f02b9385bf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:59.741397 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f52c5219-09da-4d17-817b-18f02b9385bf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:59.748875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f52c5219-09da-4d17-817b-18f02b9385bf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:59.749320 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f52c5219-09da-4d17-817b-18f02b9385bf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:59.750119 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f52c5219-09da-4d17-817b-18f02b9385bf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:59.750561 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f52c5219-09da-4d17-817b-18f02b9385bf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:59.888741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f52c5219-09da-4d17-817b-18f02b9385bf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:59.897056 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f52c5219-09da-4d17-817b-18f02b9385bf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1365 microversion: 2.1 time: 0.160058 Jun 24 08:49:59.897639 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 502/997] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:59 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:00.920102 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-53e8ffc3-d440-40af-9ca7-b2001d2dad06 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:00.921234 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-53e8ffc3-d440-40af-9ca7-b2001d2dad06 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:00.930078 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53e8ffc3-d440-40af-9ca7-b2001d2dad06 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.930528 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53e8ffc3-d440-40af-9ca7-b2001d2dad06 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.931311 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53e8ffc3-d440-40af-9ca7-b2001d2dad06 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.931808 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53e8ffc3-d440-40af-9ca7-b2001d2dad06 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.193060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-53e8ffc3-d440-40af-9ca7-b2001d2dad06 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.207626 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-53e8ffc3-d440-40af-9ca7-b2001d2dad06 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1365 microversion: 2.1 time: 0.294305 Jun 24 08:50:01.219856 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 496/998] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:00 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:02.227068 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ea94734c-16a9-4f49-bbb7-fa3e98f9a3ff tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:02.227705 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ea94734c-16a9-4f49-bbb7-fa3e98f9a3ff tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:02.234564 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea94734c-16a9-4f49-bbb7-fa3e98f9a3ff tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.235010 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea94734c-16a9-4f49-bbb7-fa3e98f9a3ff tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.235772 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea94734c-16a9-4f49-bbb7-fa3e98f9a3ff tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.236208 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea94734c-16a9-4f49-bbb7-fa3e98f9a3ff tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.368184 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ea94734c-16a9-4f49-bbb7-fa3e98f9a3ff tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:02.376175 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ea94734c-16a9-4f49-bbb7-fa3e98f9a3ff tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1365 microversion: 2.1 time: 0.152898 Jun 24 08:50:02.376763 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 503/999] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:02 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:03.291817 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-040f0eac-9d46-434a-97a2-8b00e51db7b8 req-9c62b9de-c829-4a33-b8ab-16ebf77212d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c8e6a0-6446-4747-964e-09d614c2eabd", "name": "network-vif-plugged", "status": "completed", "tag": "b123be3e-8a3c-4449-9443-f48c362c9866"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:03.300864 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-040f0eac-9d46-434a-97a2-8b00e51db7b8 req-9c62b9de-c829-4a33-b8ab-16ebf77212d0 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.301304 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-040f0eac-9d46-434a-97a2-8b00e51db7b8 req-9c62b9de-c829-4a33-b8ab-16ebf77212d0 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.312843 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-040f0eac-9d46-434a-97a2-8b00e51db7b8 req-9c62b9de-c829-4a33-b8ab-16ebf77212d0 service nova] Creating event network-vif-plugged:b123be3e-8a3c-4449-9443-f48c362c9866 for instance 99c8e6a0-6446-4747-964e-09d614c2eabd on hv-cinder-84713 Jun 24 08:50:03.318035 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-040f0eac-9d46-434a-97a2-8b00e51db7b8 req-9c62b9de-c829-4a33-b8ab-16ebf77212d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029941 Jun 24 08:50:03.318809 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 497/1000] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:03.393886 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-abec91c9-e006-47cd-b0a3-bf5697a8f8e1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:03.394846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-abec91c9-e006-47cd-b0a3-bf5697a8f8e1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:03.403732 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-abec91c9-e006-47cd-b0a3-bf5697a8f8e1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.404177 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-abec91c9-e006-47cd-b0a3-bf5697a8f8e1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.405118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-abec91c9-e006-47cd-b0a3-bf5697a8f8e1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.405947 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-abec91c9-e006-47cd-b0a3-bf5697a8f8e1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.595212 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-abec91c9-e006-47cd-b0a3-bf5697a8f8e1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.603459 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-abec91c9-e006-47cd-b0a3-bf5697a8f8e1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1365 microversion: 2.1 time: 0.213409 Jun 24 08:50:03.604257 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 504/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:03 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:04.626136 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-173b450c-e42b-44b0-8bc7-99b082f7a143 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:04.626743 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-173b450c-e42b-44b0-8bc7-99b082f7a143 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:04.629377 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:04.636823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-173b450c-e42b-44b0-8bc7-99b082f7a143 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.637260 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-173b450c-e42b-44b0-8bc7-99b082f7a143 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:04.638053 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-173b450c-e42b-44b0-8bc7-99b082f7a143 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.638481 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-173b450c-e42b-44b0-8bc7-99b082f7a143 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:04.772261 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-173b450c-e42b-44b0-8bc7-99b082f7a143 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:04.779703 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-173b450c-e42b-44b0-8bc7-99b082f7a143 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1365 microversion: 2.1 time: 0.158772 Jun 24 08:50:04.780264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 498/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:04 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:05.796725 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-044c714a-e1cd-404f-9e5f-a0f18a0cf7b4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:05.797203 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-044c714a-e1cd-404f-9e5f-a0f18a0cf7b4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:05.804016 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-044c714a-e1cd-404f-9e5f-a0f18a0cf7b4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.804463 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-044c714a-e1cd-404f-9e5f-a0f18a0cf7b4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.805230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-044c714a-e1cd-404f-9e5f-a0f18a0cf7b4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.805663 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-044c714a-e1cd-404f-9e5f-a0f18a0cf7b4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.946061 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-044c714a-e1cd-404f-9e5f-a0f18a0cf7b4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:05.954273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-044c714a-e1cd-404f-9e5f-a0f18a0cf7b4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1555 microversion: 2.1 time: 0.161389 Jun 24 08:50:05.954875 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 505/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:05 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:05.971735 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-06dfe40e-e518-434a-ac87-d5fa87a2fc6f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:05.972338 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-06dfe40e-e518-434a-ac87-d5fa87a2fc6f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:05.974271 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:05.981203 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06dfe40e-e518-434a-ac87-d5fa87a2fc6f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.981658 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06dfe40e-e518-434a-ac87-d5fa87a2fc6f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.982518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06dfe40e-e518-434a-ac87-d5fa87a2fc6f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.982957 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06dfe40e-e518-434a-ac87-d5fa87a2fc6f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.062324 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-06dfe40e-e518-434a-ac87-d5fa87a2fc6f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094603 Jun 24 08:50:06.062924 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 499/1004] 10.222.0.13 () {58 vars in 1274 bytes} [Fri Jun 24 08:50:05 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:06.721277 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-44a3b8de-778b-4d2c-ba1c-4f240a1274ec tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:06.722025 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-44a3b8de-778b-4d2c-ba1c-4f240a1274ec tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:06.723969 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:06.724707 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=10 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:06.731641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a3b8de-778b-4d2c-ba1c-4f240a1274ec tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.732088 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a3b8de-778b-4d2c-ba1c-4f240a1274ec tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.732881 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a3b8de-778b-4d2c-ba1c-4f240a1274ec tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.733301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a3b8de-778b-4d2c-ba1c-4f240a1274ec tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.869334 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-44a3b8de-778b-4d2c-ba1c-4f240a1274ec tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:06.877536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-44a3b8de-778b-4d2c-ba1c-4f240a1274ec tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1592 microversion: 2.1 time: 0.160067 Jun 24 08:50:06.878072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 506/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:06 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1592 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:07.017004 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:07.021642 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-04fcd93c-3704-4c7b-b9b5-5e1265cd8617 req-622631d8-52e4-4bc5-94e3-725a625473f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c8e6a0-6446-4747-964e-09d614c2eabd", "tag": "b123be3e-8a3c-4449-9443-f48c362c9866"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:07.031138 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-04fcd93c-3704-4c7b-b9b5-5e1265cd8617 req-622631d8-52e4-4bc5-94e3-725a625473f8 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.031569 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-04fcd93c-3704-4c7b-b9b5-5e1265cd8617 req-622631d8-52e4-4bc5-94e3-725a625473f8 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.043552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-04fcd93c-3704-4c7b-b9b5-5e1265cd8617 req-622631d8-52e4-4bc5-94e3-725a625473f8 service nova] Creating event network-changed:b123be3e-8a3c-4449-9443-f48c362c9866 for instance 99c8e6a0-6446-4747-964e-09d614c2eabd on hv-cinder-84713 Jun 24 08:50:07.048620 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-04fcd93c-3704-4c7b-b9b5-5e1265cd8617 req-622631d8-52e4-4bc5-94e3-725a625473f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032222 Jun 24 08:50:07.049413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 500/1006] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:09.076834 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-90ffdd6e-293b-42b9-a7c5-fce533cc7ad2 req-76d7b54e-55f1-4fba-9cdf-d33c362888cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3aa531-5c49-4aa6-908e-f98f9cedbda4", "tag": "847e9d65-5fa2-49be-983e-9cbfe98fb601"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:09.087384 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-90ffdd6e-293b-42b9-a7c5-fce533cc7ad2 req-76d7b54e-55f1-4fba-9cdf-d33c362888cd service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:09.087993 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-90ffdd6e-293b-42b9-a7c5-fce533cc7ad2 req-76d7b54e-55f1-4fba-9cdf-d33c362888cd service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:09.100064 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-90ffdd6e-293b-42b9-a7c5-fce533cc7ad2 req-76d7b54e-55f1-4fba-9cdf-d33c362888cd service nova] Creating event network-changed:847e9d65-5fa2-49be-983e-9cbfe98fb601 for instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 on hv-cinder-84713 Jun 24 08:50:09.105752 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-90ffdd6e-293b-42b9-a7c5-fce533cc7ad2 req-76d7b54e-55f1-4fba-9cdf-d33c362888cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034367 Jun 24 08:50:09.107416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 507/1007] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:10.084234 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-40cc86f9-2ce2-4fcc-8f7a-5d3702bd5256 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-214970642"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:10.084892 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-40cc86f9-2ce2-4fcc-8f7a-5d3702bd5256 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:10.092795 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40cc86f9-2ce2-4fcc-8f7a-5d3702bd5256 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.093241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40cc86f9-2ce2-4fcc-8f7a-5d3702bd5256 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:10.094047 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40cc86f9-2ce2-4fcc-8f7a-5d3702bd5256 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.094653 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40cc86f9-2ce2-4fcc-8f7a-5d3702bd5256 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:10.248816 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.network.security_group_api [None req-40cc86f9-2ce2-4fcc-8f7a-5d3702bd5256 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Adding security group ba8aeccd-a8fa-411d-8f5a-3618410c4a27 to port 847e9d65-5fa2-49be-983e-9cbfe98fb601 Jun 24 08:50:10.665867 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-40cc86f9-2ce2-4fcc-8f7a-5d3702bd5256 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "POST /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/action" status: 202 len: 0 microversion: 2.1 time: 0.586086 Jun 24 08:50:10.666607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 501/1008] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:50:10 2022] POST /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:50:10.677604 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9a6afb67-3e47-43b7-9c68-6d2039a62763 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:10.678189 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-35c6f91d-d089-4b3e-a274-7289a9ecf5de req-5a5eafad-bb12-4a83-92e2-1e25576eba37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3aa531-5c49-4aa6-908e-f98f9cedbda4", "tag": "847e9d65-5fa2-49be-983e-9cbfe98fb601"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:10.678736 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9a6afb67-3e47-43b7-9c68-6d2039a62763 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:10.687319 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-35c6f91d-d089-4b3e-a274-7289a9ecf5de req-5a5eafad-bb12-4a83-92e2-1e25576eba37 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.687319 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-35c6f91d-d089-4b3e-a274-7289a9ecf5de req-5a5eafad-bb12-4a83-92e2-1e25576eba37 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:10.696957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9a6afb67-3e47-43b7-9c68-6d2039a62763 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.699026 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9a6afb67-3e47-43b7-9c68-6d2039a62763 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:10.700392 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-35c6f91d-d089-4b3e-a274-7289a9ecf5de req-5a5eafad-bb12-4a83-92e2-1e25576eba37 service nova] Creating event network-changed:847e9d65-5fa2-49be-983e-9cbfe98fb601 for instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 on hv-cinder-84713 Jun 24 08:50:10.707376 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-35c6f91d-d089-4b3e-a274-7289a9ecf5de req-5a5eafad-bb12-4a83-92e2-1e25576eba37 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032837 Jun 24 08:50:10.707989 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 502/1009] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:50:10.711722 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9a6afb67-3e47-43b7-9c68-6d2039a62763 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.712185 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9a6afb67-3e47-43b7-9c68-6d2039a62763 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:11.008904 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9a6afb67-3e47-43b7-9c68-6d2039a62763 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:11.019265 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9a6afb67-3e47-43b7-9c68-6d2039a62763 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1757 microversion: 2.1 time: 0.346841 Jun 24 08:50:11.020029 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 508/1010] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:10 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1757 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:33.594643 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=9 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:33.595393 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:33.599678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-defb12ed-4062-47e1-8de4-dcf9130013e4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:33.600721 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-defb12ed-4062-47e1-8de4-dcf9130013e4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:33.609040 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-defb12ed-4062-47e1-8de4-dcf9130013e4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:33.609482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-defb12ed-4062-47e1-8de4-dcf9130013e4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:33.610290 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-defb12ed-4062-47e1-8de4-dcf9130013e4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:33.610722 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-defb12ed-4062-47e1-8de4-dcf9130013e4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:33.688856 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-defb12ed-4062-47e1-8de4-dcf9130013e4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "POST /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/action" status: 202 len: 0 microversion: 2.1 time: 0.095598 Jun 24 08:50:33.690419 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 503/1011] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:50:33 2022] POST /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:50:33.699246 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9c1c3267-262f-4652-929f-c5c9e793fde0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:33.699856 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9c1c3267-262f-4652-929f-c5c9e793fde0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:33.702166 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:33.702993 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:33.709797 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9c1c3267-262f-4652-929f-c5c9e793fde0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:33.710338 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9c1c3267-262f-4652-929f-c5c9e793fde0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:33.711384 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9c1c3267-262f-4652-929f-c5c9e793fde0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:33.711934 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9c1c3267-262f-4652-929f-c5c9e793fde0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:34.085010 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9c1c3267-262f-4652-929f-c5c9e793fde0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:34.094404 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9c1c3267-262f-4652-929f-c5c9e793fde0 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1749 microversion: 2.1 time: 0.400392 Jun 24 08:50:34.095004 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 509/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:33 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1749 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:35.113355 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c3c9cc3d-4554-479d-be05-dd3c0f544b35 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:35.114084 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c3c9cc3d-4554-479d-be05-dd3c0f544b35 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:35.121599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3c9cc3d-4554-479d-be05-dd3c0f544b35 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:35.122072 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3c9cc3d-4554-479d-be05-dd3c0f544b35 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:35.122837 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3c9cc3d-4554-479d-be05-dd3c0f544b35 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:35.123262 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3c9cc3d-4554-479d-be05-dd3c0f544b35 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:35.330080 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c3c9cc3d-4554-479d-be05-dd3c0f544b35 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:35.338327 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c3c9cc3d-4554-479d-be05-dd3c0f544b35 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.229613 Jun 24 08:50:35.338896 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 504/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:35 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:36.355877 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-26205583-3247-43df-9e3f-9883390dd399 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:36.356513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-26205583-3247-43df-9e3f-9883390dd399 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:36.363008 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26205583-3247-43df-9e3f-9883390dd399 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:36.363454 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26205583-3247-43df-9e3f-9883390dd399 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:36.364220 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26205583-3247-43df-9e3f-9883390dd399 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:36.364654 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26205583-3247-43df-9e3f-9883390dd399 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:36.508507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26205583-3247-43df-9e3f-9883390dd399 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:36.520401 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-26205583-3247-43df-9e3f-9883390dd399 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.168461 Jun 24 08:50:36.521188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 510/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:36 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:37.537540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-65530536-5dd8-4e8e-8324-f1ecb893f9b1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:37.538187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-65530536-5dd8-4e8e-8324-f1ecb893f9b1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:37.545428 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65530536-5dd8-4e8e-8324-f1ecb893f9b1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:37.545916 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65530536-5dd8-4e8e-8324-f1ecb893f9b1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:37.546688 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65530536-5dd8-4e8e-8324-f1ecb893f9b1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:37.547121 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65530536-5dd8-4e8e-8324-f1ecb893f9b1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:37.686681 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-65530536-5dd8-4e8e-8324-f1ecb893f9b1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:37.694592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-65530536-5dd8-4e8e-8324-f1ecb893f9b1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.160878 Jun 24 08:50:37.695170 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 505/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:37 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:38.712032 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-64821f1c-047e-421b-a0b6-63e9efc5adf4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:38.712642 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-64821f1c-047e-421b-a0b6-63e9efc5adf4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:38.719550 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-64821f1c-047e-421b-a0b6-63e9efc5adf4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:38.720072 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-64821f1c-047e-421b-a0b6-63e9efc5adf4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:38.720921 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-64821f1c-047e-421b-a0b6-63e9efc5adf4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:38.721392 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-64821f1c-047e-421b-a0b6-63e9efc5adf4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:38.869311 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-64821f1c-047e-421b-a0b6-63e9efc5adf4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:38.877761 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-64821f1c-047e-421b-a0b6-63e9efc5adf4 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.169521 Jun 24 08:50:38.878332 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 511/1016] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:38 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:39.896323 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-006feb01-cc5b-4487-be9f-d9b990057e9b tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:39.897143 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-006feb01-cc5b-4487-be9f-d9b990057e9b tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:39.903624 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-006feb01-cc5b-4487-be9f-d9b990057e9b tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:39.904071 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-006feb01-cc5b-4487-be9f-d9b990057e9b tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:39.904842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-006feb01-cc5b-4487-be9f-d9b990057e9b tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:39.905282 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-006feb01-cc5b-4487-be9f-d9b990057e9b tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:40.046566 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-006feb01-cc5b-4487-be9f-d9b990057e9b tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:40.054350 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-006feb01-cc5b-4487-be9f-d9b990057e9b tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.163155 Jun 24 08:50:40.054920 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 506/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:39 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:41.073745 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2368474b-07b0-485a-b904-56ada589fb92 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:41.074576 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2368474b-07b0-485a-b904-56ada589fb92 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:41.081538 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2368474b-07b0-485a-b904-56ada589fb92 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:41.082016 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2368474b-07b0-485a-b904-56ada589fb92 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:41.082950 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2368474b-07b0-485a-b904-56ada589fb92 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:41.083396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2368474b-07b0-485a-b904-56ada589fb92 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:41.226907 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2368474b-07b0-485a-b904-56ada589fb92 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:41.235042 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2368474b-07b0-485a-b904-56ada589fb92 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.166390 Jun 24 08:50:41.235617 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 512/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:41 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:42.253752 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5a855e3b-d00b-4479-8cee-7879da632145 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:42.254413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5a855e3b-d00b-4479-8cee-7879da632145 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:42.263908 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a855e3b-d00b-4479-8cee-7879da632145 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:42.264491 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a855e3b-d00b-4479-8cee-7879da632145 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:42.265509 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a855e3b-d00b-4479-8cee-7879da632145 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:42.266080 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a855e3b-d00b-4479-8cee-7879da632145 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:42.714216 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5a855e3b-d00b-4479-8cee-7879da632145 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:42.722346 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5a855e3b-d00b-4479-8cee-7879da632145 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.472688 Jun 24 08:50:42.722912 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 507/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:42 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:43.099677 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fb56379f-c3aa-4d92-a690-978530bf02ac tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:43.100380 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fb56379f-c3aa-4d92-a690-978530bf02ac tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:43.107746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fb56379f-c3aa-4d92-a690-978530bf02ac tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.108200 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fb56379f-c3aa-4d92-a690-978530bf02ac tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.108984 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fb56379f-c3aa-4d92-a690-978530bf02ac tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.109442 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fb56379f-c3aa-4d92-a690-978530bf02ac tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.137023 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fb56379f-c3aa-4d92-a690-978530bf02ac tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/ips" status: 200 len: 150 microversion: 2.1 time: 0.041171 Jun 24 08:50:43.137746 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 513/1020] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:50:43 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:43.740316 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9cb7bde1-ebd4-443d-92d8-62c8ae263b68 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:43.741062 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9cb7bde1-ebd4-443d-92d8-62c8ae263b68 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:43.748694 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cb7bde1-ebd4-443d-92d8-62c8ae263b68 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.749138 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cb7bde1-ebd4-443d-92d8-62c8ae263b68 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.749966 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cb7bde1-ebd4-443d-92d8-62c8ae263b68 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.750406 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cb7bde1-ebd4-443d-92d8-62c8ae263b68 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.922813 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9cb7bde1-ebd4-443d-92d8-62c8ae263b68 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:43.937028 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9cb7bde1-ebd4-443d-92d8-62c8ae263b68 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.200516 Jun 24 08:50:43.938230 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 508/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:43 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:44.519507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b0995614-dfc8-4e77-8626-2ac4e5709a5d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee08432b-97be-4ea8-8456-578c96bdd7bd"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:44.520737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b0995614-dfc8-4e77-8626-2ac4e5709a5d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:44.529493 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b0995614-dfc8-4e77-8626-2ac4e5709a5d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.529966 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b0995614-dfc8-4e77-8626-2ac4e5709a5d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.530833 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b0995614-dfc8-4e77-8626-2ac4e5709a5d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.531270 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b0995614-dfc8-4e77-8626-2ac4e5709a5d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.847365 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b0995614-dfc8-4e77-8626-2ac4e5709a5d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331384 Jun 24 08:50:44.848848 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 514/1022] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:50:44 2022] POST /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:50:44.960461 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-80092eaa-a1a2-4e86-b49d-aed7bdc12ae1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:44.961260 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-80092eaa-a1a2-4e86-b49d-aed7bdc12ae1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:44.969394 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-80092eaa-a1a2-4e86-b49d-aed7bdc12ae1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.969883 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-80092eaa-a1a2-4e86-b49d-aed7bdc12ae1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.970705 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-80092eaa-a1a2-4e86-b49d-aed7bdc12ae1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.971149 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-80092eaa-a1a2-4e86-b49d-aed7bdc12ae1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:45.159482 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-80092eaa-a1a2-4e86-b49d-aed7bdc12ae1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:45.169871 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-80092eaa-a1a2-4e86-b49d-aed7bdc12ae1 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1754 microversion: 2.1 time: 0.213902 Jun 24 08:50:45.170465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 509/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:44 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1754 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:46.189774 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-981cee9c-42c6-4650-90ca-6192430da2d3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:46.190652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-981cee9c-42c6-4650-90ca-6192430da2d3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:46.197979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-981cee9c-42c6-4650-90ca-6192430da2d3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:46.198447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-981cee9c-42c6-4650-90ca-6192430da2d3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:46.199255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-981cee9c-42c6-4650-90ca-6192430da2d3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:46.199700 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-981cee9c-42c6-4650-90ca-6192430da2d3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:46.387375 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-981cee9c-42c6-4650-90ca-6192430da2d3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:46.396507 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-981cee9c-42c6-4650-90ca-6192430da2d3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1757 microversion: 2.1 time: 0.211712 Jun 24 08:50:46.397029 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 515/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:46 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:52.463552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee08432b-97be-4ea8-8456-578c96bdd7bd"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:52.465414 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:52.475127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.475813 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:52.476936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.477671 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:52.584806 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Invalid volume: volume ee08432b-97be-4ea8-8456-578c96bdd7bd is already attached to instances: 99c8e6a0-6446-4747-964e-09d614c2eabd Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: POST /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments HTTP/1.1 Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 74 Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:50:52.586600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {"volumeAttachment": {"volumeId": "ee08432b-97be-4ea8-8456-578c96bdd7bd"}} Jun 24 08:50:52.588462 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Invalid volume: volume ee08432b-97be-4ea8-8456-578c96bdd7bd is already attached to instances: 99c8e6a0-6446-4747-964e-09d614c2eabd Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'server_id': '99c8e6a0-6446-4747-964e-09d614c2eabd', 'body': {'volumeAttachment': {'volumeId': 'ee08432b-97be-4ea8-8456-578c96bdd7bd'}}} Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ee08432b-97be-4ea8-8456-578c96bdd7bd is already attached to instances: 99c8e6a0-6446-4747-964e-09d614c2eabd Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:52.589384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ee08432b-97be-4ea8-8456-578c96bdd7bd is already attached to instances: 99c8e6a0-6446-4747-964e-09d614c2eabd Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:52.591644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:50:52.594068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:50:52.594068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:50:52.594068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:50:52.594068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ee08432b-97be-4ea8-8456-578c96bdd7bd is already attached to instances: 99c8e6a0-6446-4747-964e-09d614c2eabd Jun 24 08:50:52.594068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:52.594068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 400 to user: Invalid volume: volume ee08432b-97be-4ea8-8456-578c96bdd7bd is already attached to instances: 99c8e6a0-6446-4747-964e-09d614c2eabd {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:50:52.594068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-544bc678-25fd-4ead-a4cd-32095e32a097 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131500 Jun 24 08:50:52.594068 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 510/1025] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:50:52 2022] POST /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:50:52.682643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6a9d9dd-a1e3-4caf-bbc1-19c2a7d0ac2d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:52.683394 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e6a9d9dd-a1e3-4caf-bbc1-19c2a7d0ac2d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:52.692970 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6a9d9dd-a1e3-4caf-bbc1-19c2a7d0ac2d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.693475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6a9d9dd-a1e3-4caf-bbc1-19c2a7d0ac2d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:52.694297 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6a9d9dd-a1e3-4caf-bbc1-19c2a7d0ac2d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.694905 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6a9d9dd-a1e3-4caf-bbc1-19c2a7d0ac2d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:52.792235 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-e6a9d9dd-a1e3-4caf-bbc1-19c2a7d0ac2d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lazy-loading 'services' on Instance uuid 99c8e6a0-6446-4747-964e-09d614c2eabd {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:50:52.874229 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e6a9d9dd-a1e3-4caf-bbc1-19c2a7d0ac2d tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments/ee08432b-97be-4ea8-8456-578c96bdd7bd" status: 202 len: 0 microversion: 2.1 time: 0.198302 Jun 24 08:50:52.874897 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 516/1026] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:50:52 2022] DELETE /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments/ee08432b-97be-4ea8-8456-578c96bdd7bd => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:50:52.886302 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d4dd5479-4655-4fc7-99ae-1246c89b32f8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:52.887427 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d4dd5479-4655-4fc7-99ae-1246c89b32f8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:52.894013 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4dd5479-4655-4fc7-99ae-1246c89b32f8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.894500 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4dd5479-4655-4fc7-99ae-1246c89b32f8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:52.895362 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4dd5479-4655-4fc7-99ae-1246c89b32f8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.895842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4dd5479-4655-4fc7-99ae-1246c89b32f8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:52.930032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d4dd5479-4655-4fc7-99ae-1246c89b32f8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048381 Jun 24 08:50:52.930615 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 511/1027] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:50:52 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:53.943890 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dbac8753-4167-494e-a5f0-9916f2d9bd1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:53.944971 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dbac8753-4167-494e-a5f0-9916f2d9bd1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:53.952544 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dbac8753-4167-494e-a5f0-9916f2d9bd1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:53.953033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dbac8753-4167-494e-a5f0-9916f2d9bd1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:53.953907 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dbac8753-4167-494e-a5f0-9916f2d9bd1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:53.954350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dbac8753-4167-494e-a5f0-9916f2d9bd1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:53.986431 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dbac8753-4167-494e-a5f0-9916f2d9bd1c tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047424 Jun 24 08:50:53.986979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 517/1028] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:50:53 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:50:54.049641 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-068f5a0e-35db-40c9-85d6-06bdb8a47447 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:54.050302 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-068f5a0e-35db-40c9-85d6-06bdb8a47447 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:54.060397 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-068f5a0e-35db-40c9-85d6-06bdb8a47447 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.060858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-068f5a0e-35db-40c9-85d6-06bdb8a47447 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.061770 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-068f5a0e-35db-40c9-85d6-06bdb8a47447 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.062242 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-068f5a0e-35db-40c9-85d6-06bdb8a47447 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.097410 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-068f5a0e-35db-40c9-85d6-06bdb8a47447 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:50:54.186048 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-068f5a0e-35db-40c9-85d6-06bdb8a47447 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 204 len: 0 microversion: 2.1 time: 0.139622 Jun 24 08:50:54.186939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 512/1029] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:50:54 2022] DELETE /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:50:54.195895 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1181741c-a72a-44c4-a760-a0a98f4aa98a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:54.196509 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1181741c-a72a-44c4-a760-a0a98f4aa98a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:54.204057 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1181741c-a72a-44c4-a760-a0a98f4aa98a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.204499 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1181741c-a72a-44c4-a760-a0a98f4aa98a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.205268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1181741c-a72a-44c4-a760-a0a98f4aa98a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.205724 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1181741c-a72a-44c4-a760-a0a98f4aa98a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.352434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1181741c-a72a-44c4-a760-a0a98f4aa98a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:54.360492 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1181741c-a72a-44c4-a760-a0a98f4aa98a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1680 microversion: 2.1 time: 0.168682 Jun 24 08:50:54.361117 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 518/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:54 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:55.381607 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3442a7b8-0f6d-4499-bbec-a7507550e7e8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:55.382386 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3442a7b8-0f6d-4499-bbec-a7507550e7e8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:55.390923 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3442a7b8-0f6d-4499-bbec-a7507550e7e8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.391377 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3442a7b8-0f6d-4499-bbec-a7507550e7e8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.392152 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3442a7b8-0f6d-4499-bbec-a7507550e7e8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.392583 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3442a7b8-0f6d-4499-bbec-a7507550e7e8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.549422 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3442a7b8-0f6d-4499-bbec-a7507550e7e8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:55.558634 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3442a7b8-0f6d-4499-bbec-a7507550e7e8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1680 microversion: 2.1 time: 0.181515 Jun 24 08:50:55.559226 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 513/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:55 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:56.208769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-4d67dd09-5971-4833-8828-03cf2ccfa831 req-9aac2f59-036e-47e2-9ac7-1e94afbc6875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109d8faf-1466-4af8-9a69-a04f371ec7d3", "tag": "54831ccd-9e3d-43d3-b0ec-2741aac6057b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:56.215145 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-02a93e65-7cd4-492a-87b5-ac5a0c03d0aa tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:56.215718 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-02a93e65-7cd4-492a-87b5-ac5a0c03d0aa tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:56.225199 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-02a93e65-7cd4-492a-87b5-ac5a0c03d0aa tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.225655 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-02a93e65-7cd4-492a-87b5-ac5a0c03d0aa tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.225903 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4d67dd09-5971-4833-8828-03cf2ccfa831 req-9aac2f59-036e-47e2-9ac7-1e94afbc6875 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.226345 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4d67dd09-5971-4833-8828-03cf2ccfa831 req-9aac2f59-036e-47e2-9ac7-1e94afbc6875 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.226456 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-02a93e65-7cd4-492a-87b5-ac5a0c03d0aa tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.226903 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-02a93e65-7cd4-492a-87b5-ac5a0c03d0aa tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.241990 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-4d67dd09-5971-4833-8828-03cf2ccfa831 req-9aac2f59-036e-47e2-9ac7-1e94afbc6875 service nova] Creating event network-changed:54831ccd-9e3d-43d3-b0ec-2741aac6057b for instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 on hv-cinder-84713 Jun 24 08:50:56.251028 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-4d67dd09-5971-4833-8828-03cf2ccfa831 req-9aac2f59-036e-47e2-9ac7-1e94afbc6875 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050133 Jun 24 08:50:56.252260 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 514/1032] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:56.256190 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-02a93e65-7cd4-492a-87b5-ac5a0c03d0aa tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:50:56.366411 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-02a93e65-7cd4-492a-87b5-ac5a0c03d0aa tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "DELETE /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 204 len: 0 microversion: 2.1 time: 0.169534 Jun 24 08:50:56.371688 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 519/1033] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:50:56 2022] DELETE /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:50:56.377527 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-675cb736-8b7b-468d-9092-bb36ed879d88 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:56.380984 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-675cb736-8b7b-468d-9092-bb36ed879d88 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:56.389577 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-675cb736-8b7b-468d-9092-bb36ed879d88 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.390514 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-675cb736-8b7b-468d-9092-bb36ed879d88 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.391088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-675cb736-8b7b-468d-9092-bb36ed879d88 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.391549 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-675cb736-8b7b-468d-9092-bb36ed879d88 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.578916 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-39c317a7-2222-44c2-9ae5-eb9552d45c78 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:56.579646 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-39c317a7-2222-44c2-9ae5-eb9552d45c78 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:56.587268 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-39c317a7-2222-44c2-9ae5-eb9552d45c78 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.590777 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-39c317a7-2222-44c2-9ae5-eb9552d45c78 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.601078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-39c317a7-2222-44c2-9ae5-eb9552d45c78 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.601913 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-39c317a7-2222-44c2-9ae5-eb9552d45c78 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.628558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-675cb736-8b7b-468d-9092-bb36ed879d88 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:56.642427 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-675cb736-8b7b-468d-9092-bb36ed879d88 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1574 microversion: 2.1 time: 0.269436 Jun 24 08:50:56.643215 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 515/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:56 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1574 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:56.867193 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-39c317a7-2222-44c2-9ae5-eb9552d45c78 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:56.877420 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-39c317a7-2222-44c2-9ae5-eb9552d45c78 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1680 microversion: 2.1 time: 0.304384 Jun 24 08:50:56.878410 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 520/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:56 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1680 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:57.234104 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-936bf951-280c-44eb-ae37-203558caa42a req-cf9232c1-7f64-4d97-8aa9-6165b53bfe5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c8e6a0-6446-4747-964e-09d614c2eabd", "name": "network-vif-deleted", "tag": "b123be3e-8a3c-4449-9443-f48c362c9866"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:57.244336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-936bf951-280c-44eb-ae37-203558caa42a req-cf9232c1-7f64-4d97-8aa9-6165b53bfe5b service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.245651 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-936bf951-280c-44eb-ae37-203558caa42a req-cf9232c1-7f64-4d97-8aa9-6165b53bfe5b service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.263466 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-936bf951-280c-44eb-ae37-203558caa42a req-cf9232c1-7f64-4d97-8aa9-6165b53bfe5b service nova] Creating event network-vif-deleted:b123be3e-8a3c-4449-9443-f48c362c9866 for instance 99c8e6a0-6446-4747-964e-09d614c2eabd on hv-cinder-84713 Jun 24 08:50:57.269952 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-936bf951-280c-44eb-ae37-203558caa42a req-cf9232c1-7f64-4d97-8aa9-6165b53bfe5b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039550 Jun 24 08:50:57.270889 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 516/1036] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:57.663828 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2e77ff79-2c96-49a3-9f06-7917bbb821f8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:57.664504 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2e77ff79-2c96-49a3-9f06-7917bbb821f8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:57.673348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2e77ff79-2c96-49a3-9f06-7917bbb821f8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.673988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2e77ff79-2c96-49a3-9f06-7917bbb821f8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.674779 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2e77ff79-2c96-49a3-9f06-7917bbb821f8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.675289 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2e77ff79-2c96-49a3-9f06-7917bbb821f8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.892868 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2e77ff79-2c96-49a3-9f06-7917bbb821f8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:57.899045 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:57.900830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:57.903221 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2e77ff79-2c96-49a3-9f06-7917bbb821f8 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1574 microversion: 2.1 time: 0.244522 Jun 24 08:50:57.903951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 521/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:57 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1574 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:57.909458 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.910328 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.911868 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.912614 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.947036 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.947484 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.948712 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lazy-loading 'fault' on Instance uuid 99c8e6a0-6446-4747-964e-09d614c2eabd {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:50:58.000654 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:58.006331 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:58.014168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-537bbb74-0bd6-4c38-aaa4-37d7666f02a4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 200 len: 1330 microversion: 2.1 time: 0.120107 Jun 24 08:50:58.015097 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 517/1038] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:57 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:58.921999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-70911b25-fc9d-4c88-b61b-2a81d7eb5313 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:58.923625 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-70911b25-fc9d-4c88-b61b-2a81d7eb5313 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:58.933364 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-70911b25-fc9d-4c88-b61b-2a81d7eb5313 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.933849 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-70911b25-fc9d-4c88-b61b-2a81d7eb5313 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.934652 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-70911b25-fc9d-4c88-b61b-2a81d7eb5313 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.935093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-70911b25-fc9d-4c88-b61b-2a81d7eb5313 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.941098 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:59.032842 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:59.033475 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:59.042560 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:59.042994 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:59.043900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:59.044384 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:59.060751 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd HTTP/1.1 Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:50:59.062786 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:50:59.064552 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '99c8e6a0-6446-4747-964e-09d614c2eabd'} Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:50:59.065807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:50:59.067413 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:50:59.069175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:50:59.069175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-07c5b4b8-f7b4-4d13-b644-8c72c5c49f77 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 404 len: 111 microversion: 2.1 time: 0.035528 Jun 24 08:50:59.069175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 518/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:59 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:50:59.075470 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f33ad106-3e08-4d3d-b1e1-0673cc70eee5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '.version_select at 0x7f0a7cb8edc0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:59.095304 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f33ad106-3e08-4d3d-b1e1-0673cc70eee5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519853108" status: 202 len: 0 microversion: 2.1 time: 0.025350 Jun 24 08:50:59.096106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 519/1040] 10.222.0.13 () {58 vars in 1217 bytes} [Fri Jun 24 08:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519853108 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:50:59.177053 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-70911b25-fc9d-4c88-b61b-2a81d7eb5313 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:59.188451 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-70911b25-fc9d-4c88-b61b-2a81d7eb5313 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 200 len: 1455 microversion: 2.1 time: 0.270436 Jun 24 08:50:59.198299 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 522/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:58 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 1455 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:59.292812 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-f5bb1247-b288-4dc2-8ce7-5401fed03e4b req-b723725b-12dc-4397-a52e-15c0e3e2892e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109d8faf-1466-4af8-9a69-a04f371ec7d3", "name": "network-vif-deleted", "tag": "54831ccd-9e3d-43d3-b0ec-2741aac6057b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:59.304706 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-f5bb1247-b288-4dc2-8ce7-5401fed03e4b req-b723725b-12dc-4397-a52e-15c0e3e2892e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:59.305159 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-f5bb1247-b288-4dc2-8ce7-5401fed03e4b req-b723725b-12dc-4397-a52e-15c0e3e2892e service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:59.318823 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-f5bb1247-b288-4dc2-8ce7-5401fed03e4b req-b723725b-12dc-4397-a52e-15c0e3e2892e service nova] Creating event network-vif-deleted:54831ccd-9e3d-43d3-b0ec-2741aac6057b for instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 on hv-cinder-84713 Jun 24 08:50:59.324476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-f5bb1247-b288-4dc2-8ce7-5401fed03e4b req-b723725b-12dc-4397-a52e-15c0e3e2892e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039152 Jun 24 08:50:59.325431 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 520/1042] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:59.864749 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-971a0ce2-927e-4744-866b-42a76ed07dbb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: .version_select at 0x7f0a6feab4c0>, body: {"keypair": {"name": "tempest-keypair-2020598248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtomqFN6wpUWsdNGTJpD65+pmw3cL849tA4kECjxMQAFRQJHSYk8r6v4mcfi00UAraKbgpQRC++cb03LxVP8Zwxy2s3bwW9Clb+l7FrtBmADAytDcm8N5mj0+sE7mG5sQ=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:59.879060 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-971a0ce2-927e-4744-866b-42a76ed07dbb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for project 7787ee132e9e4e23b1407718fb366406. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:50:59.883129 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-971a0ce2-927e-4744-866b-42a76ed07dbb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for user 8d15a76041274e7381087bd21eb674c9 and project 7787ee132e9e4e23b1407718fb366406. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:50:59.906786 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-971a0ce2-927e-4744-866b-42a76ed07dbb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045882 Jun 24 08:50:59.907396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 523/1043] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:50:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:51:00.208600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:00.209995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 109d8faf-1466-4af8-9a69-a04f371ec7d3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:00.218606 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:00.219276 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.220438 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:00.220970 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.238428 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] HTTP exception thrown: Instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 could not be found. Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Request method failure captured: Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 HTTP/1.1 Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXkPwkLod11faN8VrsNwsEcn7aw2Z0f3lZU8KNjPmDD6cDUq6c2knfVXnds3lCcAzi8KTpWCQ_vvHhrduOICuJhOVbWAKRCKYapVv3bwBGhDjW93pr7L43ugtUQzdf0ubCu9JRWopHnDdTlw3Vbe9ZXPeu65YukHT26fKFZEocu2wFM Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:51:00.239829 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d0b95979aebe47bc92c387de59394942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d0b95979aebe47bc92c387de59394942", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: bf905723382e4372ae63d77a376982ff Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 could not be found. Jun 24 08:51:00.241464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '109d8faf-1466-4af8-9a69-a04f371ec7d3'} Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 could not be found. Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:00.242478 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 could not be found. Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 could not be found. Jun 24 08:51:00.244332 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:00.245540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Returning 404 to user: Instance 109d8faf-1466-4af8-9a69-a04f371ec7d3 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:00.245540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1ce7ef31-b606-4d0f-9a4e-3c9b6d3c7cbc tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3" status: 404 len: 111 microversion: 2.1 time: 0.038899 Jun 24 08:51:00.245540 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 521/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:00 2022] GET /compute/v2.1/servers/109d8faf-1466-4af8-9a69-a04f371ec7d3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:51:01.480683 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-417515606", "imageRef": "303224f7-fa9f-4765-b31c-c6c02b750fab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f76c266-a8af-466b-8b61-0e931014df30"}], "security_groups": [{"name": "tempest-securitygroup--242109984"}], "key_name": "tempest-keypair-2020598248", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:01.605555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] validate_networks() for [('0f76c266-a8af-466b-8b61-0e931014df30', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:51:02.029602 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:51:02.030069 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:51:02.030578 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:51:02.030984 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:51:02.031396 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:51:02.043965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.044721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.046182 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.046997 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.078808 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for project 7787ee132e9e4e23b1407718fb366406. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:51:02.085433 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Getting quotas for user 8d15a76041274e7381087bd21eb674c9 and project 7787ee132e9e4e23b1407718fb366406. Resources: {'cores', 'ram', 'instances'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:51:02.104574 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:51:02.108637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='303224f7-fa9f-4765-b31c-c6c02b750fab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:51:02.182902 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7d53c5ce-3f53-4ca8-8812-180463d1aa90 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.708054 Jun 24 08:51:02.185024 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 524/1045] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:51:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:51:02.204096 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-86878ab1-2c9f-4836-bc42-6cfec477ede4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:02.205555 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-86878ab1-2c9f-4836-bc42-6cfec477ede4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:02.280962 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-86878ab1-2c9f-4836-bc42-6cfec477ede4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:02.288270 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-86878ab1-2c9f-4836-bc42-6cfec477ede4 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1241 microversion: 2.1 time: 0.092178 Jun 24 08:51:02.289495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 522/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:02 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:03.315414 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-96a626cf-9f4b-448a-b8ed-236f0748df83 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:03.316067 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-96a626cf-9f4b-448a-b8ed-236f0748df83 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:03.324202 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96a626cf-9f4b-448a-b8ed-236f0748df83 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.324953 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96a626cf-9f4b-448a-b8ed-236f0748df83 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.325937 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96a626cf-9f4b-448a-b8ed-236f0748df83 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.326533 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-96a626cf-9f4b-448a-b8ed-236f0748df83 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.419991 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-96a626cf-9f4b-448a-b8ed-236f0748df83 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:03.433884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-96a626cf-9f4b-448a-b8ed-236f0748df83 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1301 microversion: 2.1 time: 0.128757 Jun 24 08:51:03.435332 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 525/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:03 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1301 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:03.598471 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-27c8f79b-794c-4810-8ec7-69b38f849200 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:03.599296 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27c8f79b-794c-4810-8ec7-69b38f849200 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:03.604966 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-27786d66-ccfa-4940-a845-8f15587bf8a9 req-f7d9495b-e79d-4769-9724-3604095a59ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345", "tag": "c876251e-542e-4240-b1d0-e6e3647c3f3c"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:03.608022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27c8f79b-794c-4810-8ec7-69b38f849200 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.608499 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27c8f79b-794c-4810-8ec7-69b38f849200 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.609303 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27c8f79b-794c-4810-8ec7-69b38f849200 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.609769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27c8f79b-794c-4810-8ec7-69b38f849200 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.622692 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-27786d66-ccfa-4940-a845-8f15587bf8a9 req-f7d9495b-e79d-4769-9724-3604095a59ac service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.623647 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-27786d66-ccfa-4940-a845-8f15587bf8a9 req-f7d9495b-e79d-4769-9724-3604095a59ac service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.639315 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27c8f79b-794c-4810-8ec7-69b38f849200 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:51:03.644782 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-27786d66-ccfa-4940-a845-8f15587bf8a9 req-f7d9495b-e79d-4769-9724-3604095a59ac service nova] Creating event network-changed:c876251e-542e-4240-b1d0-e6e3647c3f3c for instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 on hv-cinder-84713 Jun 24 08:51:03.653027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-27786d66-ccfa-4940-a845-8f15587bf8a9 req-f7d9495b-e79d-4769-9724-3604095a59ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056220 Jun 24 08:51:03.654040 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 526/1048] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:03.722117 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:03.767535 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-27c8f79b-794c-4810-8ec7-69b38f849200 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 204 len: 0 microversion: 2.1 time: 0.175184 Jun 24 08:51:03.769370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 523/1049] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:51:03 2022] DELETE /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:51:03.782862 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4ef25373-2459-46ad-b5df-08dae3a77208 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:03.784773 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4ef25373-2459-46ad-b5df-08dae3a77208 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:03.787856 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:03.796407 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ef25373-2459-46ad-b5df-08dae3a77208 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.796952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ef25373-2459-46ad-b5df-08dae3a77208 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.797851 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ef25373-2459-46ad-b5df-08dae3a77208 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.798359 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ef25373-2459-46ad-b5df-08dae3a77208 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:04.080167 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4ef25373-2459-46ad-b5df-08dae3a77208 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:04.089292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4ef25373-2459-46ad-b5df-08dae3a77208 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1575 microversion: 2.1 time: 0.312588 Jun 24 08:51:04.090404 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 527/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:03 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1575 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:04.461926 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-87a37f27-ba54-4ccd-b84f-e708a15c5c0a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:04.463406 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-87a37f27-ba54-4ccd-b84f-e708a15c5c0a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:04.470678 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87a37f27-ba54-4ccd-b84f-e708a15c5c0a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:04.471118 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87a37f27-ba54-4ccd-b84f-e708a15c5c0a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:04.472463 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87a37f27-ba54-4ccd-b84f-e708a15c5c0a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:04.472463 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87a37f27-ba54-4ccd-b84f-e708a15c5c0a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:04.638106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-87a37f27-ba54-4ccd-b84f-e708a15c5c0a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:04.652570 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-87a37f27-ba54-4ccd-b84f-e708a15c5c0a tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1366 microversion: 2.1 time: 0.195373 Jun 24 08:51:04.661645 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 524/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:04 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:05.110004 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-389be36e-70ff-4bb8-982f-f41db000ca4d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:05.110727 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-389be36e-70ff-4bb8-982f-f41db000ca4d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:05.119830 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-389be36e-70ff-4bb8-982f-f41db000ca4d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.120534 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-389be36e-70ff-4bb8-982f-f41db000ca4d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.121456 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-389be36e-70ff-4bb8-982f-f41db000ca4d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.121996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-389be36e-70ff-4bb8-982f-f41db000ca4d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.527185 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-389be36e-70ff-4bb8-982f-f41db000ca4d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:05.539361 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-389be36e-70ff-4bb8-982f-f41db000ca4d tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1575 microversion: 2.1 time: 0.433495 Jun 24 08:51:05.552898 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 528/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:05 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1575 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:05.675776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2116109a-d5b0-47bd-a9f8-8d07615d7f86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:05.676670 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2116109a-d5b0-47bd-a9f8-8d07615d7f86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:05.684430 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2116109a-d5b0-47bd-a9f8-8d07615d7f86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.684974 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2116109a-d5b0-47bd-a9f8-8d07615d7f86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.685917 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2116109a-d5b0-47bd-a9f8-8d07615d7f86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.686455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2116109a-d5b0-47bd-a9f8-8d07615d7f86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.058145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2116109a-d5b0-47bd-a9f8-8d07615d7f86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:06.070240 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2116109a-d5b0-47bd-a9f8-8d07615d7f86 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1366 microversion: 2.1 time: 0.398118 Jun 24 08:51:06.083695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 525/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:05 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:06.361296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-5df4493b-27d7-4790-8132-2855f93724d2 req-6ccb8192-bd9f-42a4-ac1a-c4bdefc3a1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345", "name": "network-vif-deleted", "tag": "c876251e-542e-4240-b1d0-e6e3647c3f3c"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:06.387839 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-5df4493b-27d7-4790-8132-2855f93724d2 req-6ccb8192-bd9f-42a4-ac1a-c4bdefc3a1cf service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.388822 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-5df4493b-27d7-4790-8132-2855f93724d2 req-6ccb8192-bd9f-42a4-ac1a-c4bdefc3a1cf service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.416074 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-5df4493b-27d7-4790-8132-2855f93724d2 req-6ccb8192-bd9f-42a4-ac1a-c4bdefc3a1cf service nova] Creating event network-vif-deleted:c876251e-542e-4240-b1d0-e6e3647c3f3c for instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 on hv-cinder-84713 Jun 24 08:51:06.424084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-5df4493b-27d7-4790-8132-2855f93724d2 req-6ccb8192-bd9f-42a4-ac1a-c4bdefc3a1cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078431 Jun 24 08:51:06.424707 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 529/1054] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:06.440172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-6c1d82a9-1997-4a9c-ae4c-0ebe0cb8baad req-ee0f52d3-7b6f-4880-b387-7b7c842d03a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a959ac-96d1-4ea8-b00c-f60199738daf", "tag": "ee6f0ba7-a6c4-4928-83c7-3ca4695adb95"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:06.453106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-6c1d82a9-1997-4a9c-ae4c-0ebe0cb8baad req-ee0f52d3-7b6f-4880-b387-7b7c842d03a3 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.453864 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-6c1d82a9-1997-4a9c-ae4c-0ebe0cb8baad req-ee0f52d3-7b6f-4880-b387-7b7c842d03a3 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.469164 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-6c1d82a9-1997-4a9c-ae4c-0ebe0cb8baad req-ee0f52d3-7b6f-4880-b387-7b7c842d03a3 service nova] Creating event network-changed:ee6f0ba7-a6c4-4928-83c7-3ca4695adb95 for instance c7a959ac-96d1-4ea8-b00c-f60199738daf on hv-cinder-84713 Jun 24 08:51:06.475594 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-6c1d82a9-1997-4a9c-ae4c-0ebe0cb8baad req-ee0f52d3-7b6f-4880-b387-7b7c842d03a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041378 Jun 24 08:51:06.476259 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 526/1055] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:06.562834 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7ed3f663-2a30-4834-9d1b-9d0d6e153055 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:06.563614 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7ed3f663-2a30-4834-9d1b-9d0d6e153055 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:06.573881 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ed3f663-2a30-4834-9d1b-9d0d6e153055 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.574928 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ed3f663-2a30-4834-9d1b-9d0d6e153055 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.576204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ed3f663-2a30-4834-9d1b-9d0d6e153055 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.576955 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ed3f663-2a30-4834-9d1b-9d0d6e153055 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.686229 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7ed3f663-2a30-4834-9d1b-9d0d6e153055 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf905723382e4372ae63d77a376982ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b95979aebe47bc92c387de59394942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:06.697375 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7ed3f663-2a30-4834-9d1b-9d0d6e153055 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 200 len: 1225 microversion: 2.1 time: 0.138971 Jun 24 08:51:06.698599 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 530/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:06 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:07.096330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0c7e77d7-e0f1-4d6f-8a44-ce5da1a37119 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:07.096936 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0c7e77d7-e0f1-4d6f-8a44-ce5da1a37119 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:07.105943 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c7e77d7-e0f1-4d6f-8a44-ce5da1a37119 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.106505 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c7e77d7-e0f1-4d6f-8a44-ce5da1a37119 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.107402 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c7e77d7-e0f1-4d6f-8a44-ce5da1a37119 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.107930 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c7e77d7-e0f1-4d6f-8a44-ce5da1a37119 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.378609 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0c7e77d7-e0f1-4d6f-8a44-ce5da1a37119 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:07.389501 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0c7e77d7-e0f1-4d6f-8a44-ce5da1a37119 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1366 microversion: 2.1 time: 0.300682 Jun 24 08:51:07.390502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 527/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:07 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:07.716539 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:07.717310 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:07.724253 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.724823 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.725671 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.726148 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.742174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] HTTP exception thrown: Instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 could not be found. Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Request method failure captured: Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 HTTP/1.1 Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXkPwkLod11faN8VrsNwsEcn7aw2Z0f3lZU8KNjPmDD6cDUq6c2knfVXnds3lCcAzi8KTpWCQ_vvHhrduOICuJhOVbWAKRCKYapVv3bwBGhDjW93pr7L43ugtUQzdf0ubCu9JRWopHnDdTlw3Vbe9ZXPeu65YukHT26fKFZEocu2wFM Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:51:07.745049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d0b95979aebe47bc92c387de59394942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d0b95979aebe47bc92c387de59394942", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: bf905723382e4372ae63d77a376982ff Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 could not be found. Jun 24 08:51:07.747434 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345'} Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 could not be found. Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:07.748699 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 could not be found. Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 could not be found. Jun 24 08:51:07.751152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:07.753856 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Returning 404 to user: Instance ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:07.753856 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c7a09685-17a7-41f2-afca-adb4b233a02a tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345" status: 404 len: 111 microversion: 2.1 time: 0.034901 Jun 24 08:51:07.753856 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 531/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:07 2022] GET /compute/v2.1/servers/ffc4cdd8-0ce9-49c8-9f10-e68a1ca8b345 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:51:08.242883 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:08.244869 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:08.252551 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.253004 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.253825 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.254267 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.271533 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] HTTP exception thrown: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Request method failure captured: Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 HTTP/1.1 Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXkPwkLod11faN8VrsNwsEcn7aw2Z0f3lZU8KNjPmDD6cDUq6c2knfVXnds3lCcAzi8KTpWCQ_vvHhrduOICuJhOVbWAKRCKYapVv3bwBGhDjW93pr7L43ugtUQzdf0ubCu9JRWopHnDdTlw3Vbe9ZXPeu65YukHT26fKFZEocu2wFM Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:51:08.272733 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d0b95979aebe47bc92c387de59394942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d0b95979aebe47bc92c387de59394942", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: bf905723382e4372ae63d77a376982ff Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.274965 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '343f4d48-6760-43ff-884e-cca72945b189'} Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:08.280441 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.282239 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.283876 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Returning 404 to user: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:08.283876 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ce971122-2095-401e-927a-16cf53f6219b tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "DELETE /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 404 len: 111 microversion: 2.1 time: 0.035812 Jun 24 08:51:08.283876 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 528/1059] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:51:08 2022] DELETE /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:51:08.292940 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:08.294248 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] [instance: 343f4d48-6760-43ff-884e-cca72945b189] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:08.307342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.308105 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.309099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.309805 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.328375 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] HTTP exception thrown: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Request method failure captured: Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 HTTP/1.1 Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXkPwkLod11faN8VrsNwsEcn7aw2Z0f3lZU8KNjPmDD6cDUq6c2knfVXnds3lCcAzi8KTpWCQ_vvHhrduOICuJhOVbWAKRCKYapVv3bwBGhDjW93pr7L43ugtUQzdf0ubCu9JRWopHnDdTlw3Vbe9ZXPeu65YukHT26fKFZEocu2wFM Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:51:08.330062 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d0b95979aebe47bc92c387de59394942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d0b95979aebe47bc92c387de59394942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d0b95979aebe47bc92c387de59394942", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: d0b95979aebe47bc92c387de59394942 Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-TestVolumeBootPattern-1234163673 Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: bf905723382e4372ae63d77a376982ff Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-TestVolumeBootPattern-1234163673-project Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.331951 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '343f4d48-6760-43ff-884e-cca72945b189'} Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:08.333475 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. Jun 24 08:51:08.335094 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:08.338753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Returning 404 to user: Instance 343f4d48-6760-43ff-884e-cca72945b189 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:08.338753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7944ddf2-91d9-480e-a7b7-0db80019c2f6 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189" status: 404 len: 111 microversion: 2.1 time: 0.045609 Jun 24 08:51:08.338753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 532/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:08 2022] GET /compute/v2.1/servers/343f4d48-6760-43ff-884e-cca72945b189 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:51:08.416277 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ac4b3b21-8334-419f-970b-fc9afe269833 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:08.417668 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ac4b3b21-8334-419f-970b-fc9afe269833 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:08.427061 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac4b3b21-8334-419f-970b-fc9afe269833 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.427637 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac4b3b21-8334-419f-970b-fc9afe269833 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.428636 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac4b3b21-8334-419f-970b-fc9afe269833 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.429422 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac4b3b21-8334-419f-970b-fc9afe269833 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.675846 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ac4b3b21-8334-419f-970b-fc9afe269833 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:08.688097 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ac4b3b21-8334-419f-970b-fc9afe269833 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1366 microversion: 2.1 time: 0.277642 Jun 24 08:51:08.689108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 529/1061] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:08 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:09.709069 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-69b240ac-6e91-4378-af2b-40b3be2a862b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:09.709975 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-69b240ac-6e91-4378-af2b-40b3be2a862b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:09.718288 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69b240ac-6e91-4378-af2b-40b3be2a862b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:09.718750 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69b240ac-6e91-4378-af2b-40b3be2a862b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:09.719705 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69b240ac-6e91-4378-af2b-40b3be2a862b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:09.720529 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69b240ac-6e91-4378-af2b-40b3be2a862b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:09.739803 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-260a7cbe-3d7b-43a6-8ec0-3a64aa095472 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] Calling method '.version_select at 0x7f0a7cb71940>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:09.766386 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-260a7cbe-3d7b-43a6-8ec0-3a64aa095472 tempest-TestVolumeBootPattern-1234163673 tempest-TestVolumeBootPattern-1234163673-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-825893973" status: 202 len: 0 microversion: 2.1 time: 0.029933 Jun 24 08:51:09.767195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 530/1062] 10.222.0.13 () {58 vars in 1259 bytes} [Fri Jun 24 08:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-825893973 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:51:09.898708 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-69b240ac-6e91-4378-af2b-40b3be2a862b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:09.907350 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-69b240ac-6e91-4378-af2b-40b3be2a862b tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1366 microversion: 2.1 time: 0.202661 Jun 24 08:51:09.907960 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 533/1063] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:09 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:10.925025 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ffd650df-e741-48a8-b502-cf73955b092f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:10.925977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ffd650df-e741-48a8-b502-cf73955b092f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:10.933883 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffd650df-e741-48a8-b502-cf73955b092f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.934472 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffd650df-e741-48a8-b502-cf73955b092f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:10.935576 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffd650df-e741-48a8-b502-cf73955b092f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.936124 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffd650df-e741-48a8-b502-cf73955b092f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.108442 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ffd650df-e741-48a8-b502-cf73955b092f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:11.116617 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ffd650df-e741-48a8-b502-cf73955b092f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1366 microversion: 2.1 time: 0.195938 Jun 24 08:51:11.117208 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 531/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:10 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:11.749656 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-011911c6-0918-4a1b-b891-805bd890948e req-c3d9fe9c-e2f9-4dff-a5c9-f4ee10473034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a959ac-96d1-4ea8-b00c-f60199738daf", "name": "network-vif-plugged", "status": "completed", "tag": "ee6f0ba7-a6c4-4928-83c7-3ca4695adb95"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:11.763523 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-011911c6-0918-4a1b-b891-805bd890948e req-c3d9fe9c-e2f9-4dff-a5c9-f4ee10473034 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:11.764348 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-011911c6-0918-4a1b-b891-805bd890948e req-c3d9fe9c-e2f9-4dff-a5c9-f4ee10473034 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.777261 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-011911c6-0918-4a1b-b891-805bd890948e req-c3d9fe9c-e2f9-4dff-a5c9-f4ee10473034 service nova] Creating event network-vif-plugged:ee6f0ba7-a6c4-4928-83c7-3ca4695adb95 for instance c7a959ac-96d1-4ea8-b00c-f60199738daf on hv-cinder-84713 Jun 24 08:51:11.783943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-011911c6-0918-4a1b-b891-805bd890948e req-c3d9fe9c-e2f9-4dff-a5c9-f4ee10473034 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037535 Jun 24 08:51:11.784823 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 534/1065] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:12.134974 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7f2ab65b-df70-4be0-834c-56d5ace1d7af tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:12.135720 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7f2ab65b-df70-4be0-834c-56d5ace1d7af tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:12.142331 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f2ab65b-df70-4be0-834c-56d5ace1d7af tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.142860 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f2ab65b-df70-4be0-834c-56d5ace1d7af tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.143719 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f2ab65b-df70-4be0-834c-56d5ace1d7af tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.144220 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f2ab65b-df70-4be0-834c-56d5ace1d7af tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.285447 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:12.349454 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7f2ab65b-df70-4be0-834c-56d5ace1d7af tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:12.359866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7f2ab65b-df70-4be0-834c-56d5ace1d7af tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1366 microversion: 2.1 time: 0.230281 Jun 24 08:51:12.360541 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 532/1066] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:12 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:13.379027 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a491e7ce-441b-4adf-863d-ce2e8e988f35 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:13.380801 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a491e7ce-441b-4adf-863d-ce2e8e988f35 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:13.384174 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:13.385266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=10 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:13.391943 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a491e7ce-441b-4adf-863d-ce2e8e988f35 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:13.392680 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a491e7ce-441b-4adf-863d-ce2e8e988f35 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:13.393461 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a491e7ce-441b-4adf-863d-ce2e8e988f35 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:13.394164 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a491e7ce-441b-4adf-863d-ce2e8e988f35 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:13.544193 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a491e7ce-441b-4adf-863d-ce2e8e988f35 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:13.557375 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a491e7ce-441b-4adf-863d-ce2e8e988f35 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1556 microversion: 2.1 time: 0.183039 Jun 24 08:51:13.558482 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 535/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:13 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:13.574866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9f33ed98-45d4-4e25-b8b2-312f083db11f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:13.575455 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9f33ed98-45d4-4e25-b8b2-312f083db11f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:13.582353 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f33ed98-45d4-4e25-b8b2-312f083db11f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:13.582866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f33ed98-45d4-4e25-b8b2-312f083db11f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:13.583798 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f33ed98-45d4-4e25-b8b2-312f083db11f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:13.584196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f33ed98-45d4-4e25-b8b2-312f083db11f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:13.681946 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9f33ed98-45d4-4e25-b8b2-312f083db11f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111313 Jun 24 08:51:13.682735 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 533/1068] 10.222.0.13 () {58 vars in 1274 bytes} [Fri Jun 24 08:51:13 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:14.703660 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-87197b88-890f-49c7-8b7b-2e753d1644fb req-222cb853-12b9-479f-9c5d-87ed6f1029d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a959ac-96d1-4ea8-b00c-f60199738daf", "tag": "ee6f0ba7-a6c4-4928-83c7-3ca4695adb95"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:14.714163 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-87197b88-890f-49c7-8b7b-2e753d1644fb req-222cb853-12b9-479f-9c5d-87ed6f1029d2 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:14.714737 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-87197b88-890f-49c7-8b7b-2e753d1644fb req-222cb853-12b9-479f-9c5d-87ed6f1029d2 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:14.727774 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-87197b88-890f-49c7-8b7b-2e753d1644fb req-222cb853-12b9-479f-9c5d-87ed6f1029d2 service nova] Creating event network-changed:ee6f0ba7-a6c4-4928-83c7-3ca4695adb95 for instance c7a959ac-96d1-4ea8-b00c-f60199738daf on hv-cinder-84713 Jun 24 08:51:14.735490 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-87197b88-890f-49c7-8b7b-2e753d1644fb req-222cb853-12b9-479f-9c5d-87ed6f1029d2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036305 Jun 24 08:51:14.739848 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 536/1069] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:51:19.107178 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2f5970c0-31e0-43e9-bad5-4a65f51301a3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-214970642"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:19.107799 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2f5970c0-31e0-43e9-bad5-4a65f51301a3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:19.113888 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f5970c0-31e0-43e9-bad5-4a65f51301a3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:19.114348 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f5970c0-31e0-43e9-bad5-4a65f51301a3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:19.115115 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f5970c0-31e0-43e9-bad5-4a65f51301a3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:19.115551 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f5970c0-31e0-43e9-bad5-4a65f51301a3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:19.249264 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.network.security_group_api [None req-2f5970c0-31e0-43e9-bad5-4a65f51301a3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Removing security group ba8aeccd-a8fa-411d-8f5a-3618410c4a27 from port 847e9d65-5fa2-49be-983e-9cbfe98fb601 Jun 24 08:51:19.596509 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2f5970c0-31e0-43e9-bad5-4a65f51301a3 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "POST /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/action" status: 202 len: 0 microversion: 2.1 time: 0.493622 Jun 24 08:51:19.602769 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 534/1070] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:51:19 2022] POST /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:51:19.610312 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-155dc28e-662e-441d-ad79-de672954db39 req-7e8e16e8-61fb-4696-8d98-3d77f04dc19b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3aa531-5c49-4aa6-908e-f98f9cedbda4", "tag": "847e9d65-5fa2-49be-983e-9cbfe98fb601"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:19.622240 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-155dc28e-662e-441d-ad79-de672954db39 req-7e8e16e8-61fb-4696-8d98-3d77f04dc19b service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:19.623357 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-155dc28e-662e-441d-ad79-de672954db39 req-7e8e16e8-61fb-4696-8d98-3d77f04dc19b service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:19.639965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-155dc28e-662e-441d-ad79-de672954db39 req-7e8e16e8-61fb-4696-8d98-3d77f04dc19b service nova] Creating event network-changed:847e9d65-5fa2-49be-983e-9cbfe98fb601 for instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 on hv-cinder-84713 Jun 24 08:51:19.646018 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-155dc28e-662e-441d-ad79-de672954db39 req-7e8e16e8-61fb-4696-8d98-3d77f04dc19b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040728 Jun 24 08:51:19.647173 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 537/1071] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:21.129343 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-21890e38-dc38-44d9-a5b2-b8f736dff4b6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:21.129943 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-21890e38-dc38-44d9-a5b2-b8f736dff4b6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:21.136916 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21890e38-dc38-44d9-a5b2-b8f736dff4b6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:21.137359 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21890e38-dc38-44d9-a5b2-b8f736dff4b6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:21.138223 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21890e38-dc38-44d9-a5b2-b8f736dff4b6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:21.138592 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21890e38-dc38-44d9-a5b2-b8f736dff4b6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:21.223175 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-21890e38-dc38-44d9-a5b2-b8f736dff4b6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lazy-loading 'services' on Instance uuid 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:51:21.305991 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-21890e38-dc38-44d9-a5b2-b8f736dff4b6 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments/0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef" status: 202 len: 0 microversion: 2.1 time: 0.181330 Jun 24 08:51:21.306696 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 535/1072] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:51:21 2022] DELETE /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments/0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:51:21.317637 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3463ad96-1ded-4969-afb8-42f85c82e240 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:21.319383 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3463ad96-1ded-4969-afb8-42f85c82e240 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:21.326852 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3463ad96-1ded-4969-afb8-42f85c82e240 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:21.327397 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3463ad96-1ded-4969-afb8-42f85c82e240 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:21.328258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3463ad96-1ded-4969-afb8-42f85c82e240 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:21.328818 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3463ad96-1ded-4969-afb8-42f85c82e240 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:21.377999 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3463ad96-1ded-4969-afb8-42f85c82e240 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060572 Jun 24 08:51:21.383352 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 538/1073] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:21 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:51:21.665908 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-26daed6d-f677-464f-9bc6-3f2562e9fed3 req-b11d5704-f5c9-42ca-9c54-ff18143a2835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3aa531-5c49-4aa6-908e-f98f9cedbda4", "tag": "847e9d65-5fa2-49be-983e-9cbfe98fb601"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:21.679558 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-26daed6d-f677-464f-9bc6-3f2562e9fed3 req-b11d5704-f5c9-42ca-9c54-ff18143a2835 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:21.680200 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-26daed6d-f677-464f-9bc6-3f2562e9fed3 req-b11d5704-f5c9-42ca-9c54-ff18143a2835 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:21.694043 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-26daed6d-f677-464f-9bc6-3f2562e9fed3 req-b11d5704-f5c9-42ca-9c54-ff18143a2835 service nova] Creating event network-changed:847e9d65-5fa2-49be-983e-9cbfe98fb601 for instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 on hv-cinder-84713 Jun 24 08:51:21.699475 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-26daed6d-f677-464f-9bc6-3f2562e9fed3 req-b11d5704-f5c9-42ca-9c54-ff18143a2835 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039560 Jun 24 08:51:21.700067 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 536/1074] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:22.392762 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8d3e8fb4-f0e7-45e4-bdc1-39f74441e4f9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:22.393717 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8d3e8fb4-f0e7-45e4-bdc1-39f74441e4f9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:22.403043 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d3e8fb4-f0e7-45e4-bdc1-39f74441e4f9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:22.403495 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d3e8fb4-f0e7-45e4-bdc1-39f74441e4f9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:22.404266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d3e8fb4-f0e7-45e4-bdc1-39f74441e4f9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:22.404712 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d3e8fb4-f0e7-45e4-bdc1-39f74441e4f9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:22.435596 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8d3e8fb4-f0e7-45e4-bdc1-39f74441e4f9 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048889 Jun 24 08:51:22.436193 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 539/1075] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:22 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:51:22.447908 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:22.448496 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:22.454735 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:22.455182 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:22.455948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:22.456388 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:22.530689 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] HTTP exception thrown: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 is not attached to volume 0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Request method failure captured: Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments/0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef HTTP/1.1 Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXqQsQlJSWAlRVofs-x8TdnuAH6WVNkpbqdc-cwT2zYqPKCgA0ZOvw8DFnnLXoc0Bts9ek3PsHntVzdHwsVhWDLqbRP7R5xB0f_oFvH7cFuKVVOTsomsNykhrCsKiTo2IebdzSLf73OPG_EfxQgh0TXAZ7Gl5grYOnjOMTKLM-QVcIg Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 2fa7360005f4416f87703d3efb18d3e1 Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestMinimumBasicScenario-7444565 Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:51:22.532934 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fa7360005f4416f87703d3efb18d3e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fa7360005f4416f87703d3efb18d3e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fa7360005f4416f87703d3efb18d3e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fa7360005f4416f87703d3efb18d3e1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestMinimumBasicScenario-7444565 Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 2fa7360005f4416f87703d3efb18d3e1 Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestMinimumBasicScenario-7444565 Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-TestMinimumBasicScenario-7444565-project Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: c5cd4e3fa19443a885d9dcb3e4bfcf5f Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestMinimumBasicScenario-7444565-project Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:51:22.534600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 is not attached to volume 0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'server_id': '4e3aa531-5c49-4aa6-908e-f98f9cedbda4', 'id': '0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef'} Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef. Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:22.535522 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 is not attached to volume 0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 is not attached to volume 0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:22.536977 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Returning 404 to user: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 is not attached to volume 0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:22.538213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7ddfc7a1-d040-4705-a696-bf0f6f36c043 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments/0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef" status: 404 len: 154 microversion: 2.1 time: 0.091940 Jun 24 08:51:22.538213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 537/1076] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:51:22 2022] DELETE /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4/os-volume_attachments/0e66dcbe-1a20-4e09-a3c9-53f3ec30e8ef => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:51:23.672049 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-43238b73-d781-43ac-8a7b-d732571b328f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:23.672650 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-43238b73-d781-43ac-8a7b-d732571b328f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:23.679400 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-43238b73-d781-43ac-8a7b-d732571b328f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:23.680564 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-43238b73-d781-43ac-8a7b-d732571b328f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:23.681515 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-43238b73-d781-43ac-8a7b-d732571b328f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:23.681987 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-43238b73-d781-43ac-8a7b-d732571b328f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:23.709170 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-43238b73-d781-43ac-8a7b-d732571b328f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:51:23.944099 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-43238b73-d781-43ac-8a7b-d732571b328f tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 204 len: 0 microversion: 2.1 time: 0.275699 Jun 24 08:51:23.944706 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 540/1077] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:51:23 2022] DELETE /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:51:23.953107 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0ffd1e53-e8bb-4a45-bb56-7af9e6f144bc tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:23.954010 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0ffd1e53-e8bb-4a45-bb56-7af9e6f144bc tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:23.961521 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0ffd1e53-e8bb-4a45-bb56-7af9e6f144bc tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:23.962250 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0ffd1e53-e8bb-4a45-bb56-7af9e6f144bc tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:23.963108 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0ffd1e53-e8bb-4a45-bb56-7af9e6f144bc tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:23.963541 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0ffd1e53-e8bb-4a45-bb56-7af9e6f144bc tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:24.103224 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0ffd1e53-e8bb-4a45-bb56-7af9e6f144bc tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:24.110757 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0ffd1e53-e8bb-4a45-bb56-7af9e6f144bc tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1552 microversion: 2.1 time: 0.161631 Jun 24 08:51:24.111321 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 538/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:23 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:25.128989 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9baa3b41-cce0-422f-8241-7ebf0d2f3c8c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:25.129707 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9baa3b41-cce0-422f-8241-7ebf0d2f3c8c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:25.137283 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9baa3b41-cce0-422f-8241-7ebf0d2f3c8c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:25.137754 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9baa3b41-cce0-422f-8241-7ebf0d2f3c8c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:25.138525 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9baa3b41-cce0-422f-8241-7ebf0d2f3c8c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:25.138990 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9baa3b41-cce0-422f-8241-7ebf0d2f3c8c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:25.272530 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9baa3b41-cce0-422f-8241-7ebf0d2f3c8c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:25.279966 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9baa3b41-cce0-422f-8241-7ebf0d2f3c8c tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1552 microversion: 2.1 time: 0.155460 Jun 24 08:51:25.280521 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 541/1079] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:25 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:26.298241 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f97e465b-cae0-41ff-a186-4a404015c80d tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:26.301995 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f97e465b-cae0-41ff-a186-4a404015c80d tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:26.310838 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f97e465b-cae0-41ff-a186-4a404015c80d tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:26.312130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f97e465b-cae0-41ff-a186-4a404015c80d tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:26.312130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f97e465b-cae0-41ff-a186-4a404015c80d tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:26.312912 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f97e465b-cae0-41ff-a186-4a404015c80d tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:26.564010 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f97e465b-cae0-41ff-a186-4a404015c80d tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5cd4e3fa19443a885d9dcb3e4bfcf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7360005f4416f87703d3efb18d3e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:26.567518 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:26.574350 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f97e465b-cae0-41ff-a186-4a404015c80d tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 200 len: 1552 microversion: 2.1 time: 0.280271 Jun 24 08:51:26.574935 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 539/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:26 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 1552 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:26.772832 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-3b437fa7-d74b-4fa7-828a-1bdd747335d9 req-4593f487-216e-4cd3-8321-f8f7d4835c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3aa531-5c49-4aa6-908e-f98f9cedbda4", "name": "network-vif-deleted", "tag": "847e9d65-5fa2-49be-983e-9cbfe98fb601"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:26.782280 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-3b437fa7-d74b-4fa7-828a-1bdd747335d9 req-4593f487-216e-4cd3-8321-f8f7d4835c04 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:26.782740 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-3b437fa7-d74b-4fa7-828a-1bdd747335d9 req-4593f487-216e-4cd3-8321-f8f7d4835c04 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:26.797304 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-3b437fa7-d74b-4fa7-828a-1bdd747335d9 req-4593f487-216e-4cd3-8321-f8f7d4835c04 service nova] Creating event network-vif-deleted:847e9d65-5fa2-49be-983e-9cbfe98fb601 for instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 on hv-cinder-84713 Jun 24 08:51:26.802425 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-3b437fa7-d74b-4fa7-828a-1bdd747335d9 req-4593f487-216e-4cd3-8321-f8f7d4835c04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033198 Jun 24 08:51:26.803004 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 542/1081] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:27.592091 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:27.592819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] [instance: 4e3aa531-5c49-4aa6-908e-f98f9cedbda4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:27.600055 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:27.600491 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:27.601249 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:27.602460 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:27.615650 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] HTTP exception thrown: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 could not be found. Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Request method failure captured: Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 HTTP/1.1 Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXqQsQlJSWAlRVofs-x8TdnuAH6WVNkpbqdc-cwT2zYqPKCgA0ZOvw8DFnnLXoc0Bts9ek3PsHntVzdHwsVhWDLqbRP7R5xB0f_oFvH7cFuKVVOTsomsNykhrCsKiTo2IebdzSLf73OPG_EfxQgh0TXAZ7Gl5grYOnjOMTKLM-QVcIg Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 2fa7360005f4416f87703d3efb18d3e1 Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestMinimumBasicScenario-7444565 Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:51:27.617866 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fa7360005f4416f87703d3efb18d3e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2fa7360005f4416f87703d3efb18d3e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2fa7360005f4416f87703d3efb18d3e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2fa7360005f4416f87703d3efb18d3e1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestMinimumBasicScenario-7444565 Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 2fa7360005f4416f87703d3efb18d3e1 Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestMinimumBasicScenario-7444565 Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-TestMinimumBasicScenario-7444565-project Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: c5cd4e3fa19443a885d9dcb3e4bfcf5f Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestMinimumBasicScenario-7444565-project Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 could not be found. Jun 24 08:51:27.619187 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '4e3aa531-5c49-4aa6-908e-f98f9cedbda4'} Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 could not be found. Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:27.619959 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 could not be found. Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 could not be found. Jun 24 08:51:27.621538 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:27.622962 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Returning 404 to user: Instance 4e3aa531-5c49-4aa6-908e-f98f9cedbda4 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:27.622962 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-81b2b531-f740-46b5-854d-b8df26a47230 tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4" status: 404 len: 111 microversion: 2.1 time: 0.031498 Jun 24 08:51:27.622962 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 540/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:27 2022] GET /compute/v2.1/servers/4e3aa531-5c49-4aa6-908e-f98f9cedbda4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:51:27.629643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a1e47e4d-b048-40fe-8e78-0fb39f5dee4e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] Calling method '.version_select at 0x7f0a6fdf11f0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:27.646901 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a1e47e4d-b048-40fe-8e78-0fb39f5dee4e tempest-TestMinimumBasicScenario-7444565 tempest-TestMinimumBasicScenario-7444565-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-702012254" status: 202 len: 0 microversion: 2.1 time: 0.021404 Jun 24 08:51:27.647447 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 543/1083] 10.222.0.13 () {58 vars in 1268 bytes} [Fri Jun 24 08:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-702012254 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:51:47.511427 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:47.512245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:47.730581 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fd7f8cfd-cb66-4850-a6aa-a2423f41a940 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Action: 'create', calling method: .version_select at 0x7f0a7ca51ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1932660844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGQ7VummkHkAFlGK013OqQGCYw2rp6wjGCNJo8rXao/s9h/qo7JkIwxWT27w+HoNqiJ+fnCvKVNnp5LLHAHB5DZ6coSgK/scTz0+thZKZ0nI8s7aOwrrFYSYtjs2GkDKQ=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:47.745464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-fd7f8cfd-cb66-4850-a6aa-a2423f41a940 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Getting quotas for project 33c8998057e6449e9c881b1b279faadd. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:51:47.749582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-fd7f8cfd-cb66-4850-a6aa-a2423f41a940 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Getting quotas for user 038c41319feb49a486832af853c332b1 and project 33c8998057e6449e9c881b1b279faadd. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:51:47.774846 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fd7f8cfd-cb66-4850-a6aa-a2423f41a940 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.268813 Jun 24 08:51:47.776074 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 541/1084] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Jun 24 08:51:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:50.737127 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2a9212d3-515d-47be-8e4c-df1f1e89abdf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:50.737867 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2a9212d3-515d-47be-8e4c-df1f1e89abdf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:50.741347 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:50.742411 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:50.749512 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a9212d3-515d-47be-8e4c-df1f1e89abdf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:50.750299 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a9212d3-515d-47be-8e4c-df1f1e89abdf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:50.751112 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a9212d3-515d-47be-8e4c-df1f1e89abdf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:50.751593 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a9212d3-515d-47be-8e4c-df1f1e89abdf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:50.781727 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2a9212d3-515d-47be-8e4c-df1f1e89abdf tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/ips" status: 200 len: 149 microversion: 2.1 time: 0.048372 Jun 24 08:51:50.782417 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 544/1085] 10.222.0.13 () {58 vars in 1247 bytes} [Fri Jun 24 08:51:50 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:52.253980 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1aa37292-42e7-4801-b9b7-e96e5b8ccda1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6be800f5-edea-41f6-ba82-707f84bea104"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:52.255299 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1aa37292-42e7-4801-b9b7-e96e5b8ccda1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:52.265218 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1aa37292-42e7-4801-b9b7-e96e5b8ccda1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:52.265674 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1aa37292-42e7-4801-b9b7-e96e5b8ccda1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:52.266512 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1aa37292-42e7-4801-b9b7-e96e5b8ccda1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:52.266953 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1aa37292-42e7-4801-b9b7-e96e5b8ccda1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:52.540024 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1aa37292-42e7-4801-b9b7-e96e5b8ccda1 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "POST /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290304 Jun 24 08:51:52.540656 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 542/1086] 10.222.0.13 () {60 vars in 1322 bytes} [Fri Jun 24 08:51:52 2022] POST /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:00.191258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ccdef29a-1461-4ff2-b2d9-48096bb60418 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:00.191880 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ccdef29a-1461-4ff2-b2d9-48096bb60418 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:00.199239 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ccdef29a-1461-4ff2-b2d9-48096bb60418 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:00.199693 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ccdef29a-1461-4ff2-b2d9-48096bb60418 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:00.200503 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ccdef29a-1461-4ff2-b2d9-48096bb60418 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:00.200945 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ccdef29a-1461-4ff2-b2d9-48096bb60418 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:00.283321 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-ccdef29a-1461-4ff2-b2d9-48096bb60418 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lazy-loading 'services' on Instance uuid c7a959ac-96d1-4ea8-b00c-f60199738daf {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:52:00.360496 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ccdef29a-1461-4ff2-b2d9-48096bb60418 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-volume_attachments/6be800f5-edea-41f6-ba82-707f84bea104" status: 202 len: 0 microversion: 2.1 time: 0.173085 Jun 24 08:52:00.361101 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 545/1087] 10.222.0.13 () {58 vars in 1415 bytes} [Fri Jun 24 08:52:00 2022] DELETE /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-volume_attachments/6be800f5-edea-41f6-ba82-707f84bea104 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:52:00.375100 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f564b377-ab9e-4d6b-ad27-cfb43751d4be tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:00.376885 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f564b377-ab9e-4d6b-ad27-cfb43751d4be tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:00.380536 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:00.388674 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f564b377-ab9e-4d6b-ad27-cfb43751d4be tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:00.389120 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f564b377-ab9e-4d6b-ad27-cfb43751d4be tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:00.390127 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f564b377-ab9e-4d6b-ad27-cfb43751d4be tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:00.390562 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f564b377-ab9e-4d6b-ad27-cfb43751d4be tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:00.422154 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f564b377-ab9e-4d6b-ad27-cfb43751d4be tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055545 Jun 24 08:52:00.422741 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 543/1088] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:00 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:01.434536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2ac0d97a-4e5a-4238-9331-4b6533855d13 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:01.435553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2ac0d97a-4e5a-4238-9331-4b6533855d13 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:01.442907 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ac0d97a-4e5a-4238-9331-4b6533855d13 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.443285 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ac0d97a-4e5a-4238-9331-4b6533855d13 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.444069 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ac0d97a-4e5a-4238-9331-4b6533855d13 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.444545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ac0d97a-4e5a-4238-9331-4b6533855d13 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.481526 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2ac0d97a-4e5a-4238-9331-4b6533855d13 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051837 Jun 24 08:52:01.482156 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 546/1089] 10.222.0.13 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:01 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:52:01.542197 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3b833a57-1097-4357-b0be-b42adb7817fb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:01.542775 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3b833a57-1097-4357-b0be-b42adb7817fb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:01.549224 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b833a57-1097-4357-b0be-b42adb7817fb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.549670 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b833a57-1097-4357-b0be-b42adb7817fb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.550480 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b833a57-1097-4357-b0be-b42adb7817fb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.550910 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b833a57-1097-4357-b0be-b42adb7817fb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.577362 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3b833a57-1097-4357-b0be-b42adb7817fb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:52:01.662776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3b833a57-1097-4357-b0be-b42adb7817fb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 204 len: 0 microversion: 2.1 time: 0.124801 Jun 24 08:52:01.663641 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 544/1090] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:52:01 2022] DELETE /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:52:01.672164 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-25733cac-8ca1-4526-9fa8-085a636ce1ed tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:01.672780 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-25733cac-8ca1-4526-9fa8-085a636ce1ed tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:01.678853 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25733cac-8ca1-4526-9fa8-085a636ce1ed tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.679308 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25733cac-8ca1-4526-9fa8-085a636ce1ed tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.680694 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25733cac-8ca1-4526-9fa8-085a636ce1ed tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.681255 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25733cac-8ca1-4526-9fa8-085a636ce1ed tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.821332 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-25733cac-8ca1-4526-9fa8-085a636ce1ed tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:01.829026 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-25733cac-8ca1-4526-9fa8-085a636ce1ed tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1680 microversion: 2.1 time: 0.160664 Jun 24 08:52:01.829604 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 547/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:01 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:02.847379 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-61e903f2-ba68-4173-b40f-f74ffe0b6149 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:02.848088 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-61e903f2-ba68-4173-b40f-f74ffe0b6149 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:02.855473 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61e903f2-ba68-4173-b40f-f74ffe0b6149 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:02.855922 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61e903f2-ba68-4173-b40f-f74ffe0b6149 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:02.856709 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61e903f2-ba68-4173-b40f-f74ffe0b6149 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:02.857147 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61e903f2-ba68-4173-b40f-f74ffe0b6149 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:03.009041 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-61e903f2-ba68-4173-b40f-f74ffe0b6149 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:03.011197 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-61e903f2-ba68-4173-b40f-f74ffe0b6149 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1680 microversion: 2.1 time: 0.168053 Jun 24 08:52:03.011776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 545/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:02 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:04.029514 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8c10f759-c7b9-407a-9824-a625511968bb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:04.030357 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8c10f759-c7b9-407a-9824-a625511968bb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:04.037244 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c10f759-c7b9-407a-9824-a625511968bb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.037790 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c10f759-c7b9-407a-9824-a625511968bb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.038635 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c10f759-c7b9-407a-9824-a625511968bb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.039711 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8c10f759-c7b9-407a-9824-a625511968bb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.072333 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1848466866", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1932660844", "security_groups": [{"name": "tempest-secgroup-smoke-1535414867"}], "networks": [{"uuid": "8f34e4b3-e091-4b10-ad7c-075470c223df"}], "block_device_mapping_v2": [{"uuid": "c80dd734-6517-4658-948c-3c46e44030c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:04.318840 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] validate_networks() for [('8f34e4b3-e091-4b10-ad7c-075470c223df', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:52:04.326328 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8c10f759-c7b9-407a-9824-a625511968bb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d15a76041274e7381087bd21eb674c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7787ee132e9e4e23b1407718fb366406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:04.333768 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8c10f759-c7b9-407a-9824-a625511968bb tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 200 len: 1680 microversion: 2.1 time: 0.308268 Jun 24 08:52:04.334342 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 548/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:04 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 1680 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:04.801730 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-672bee14-1bb9-4e32-9f03-c1abc08aab63 req-88acbd05-89cf-4e0f-aa59-b8eb58aeae61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a959ac-96d1-4ea8-b00c-f60199738daf", "name": "network-vif-deleted", "tag": "ee6f0ba7-a6c4-4928-83c7-3ca4695adb95"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:04.816433 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-672bee14-1bb9-4e32-9f03-c1abc08aab63 req-88acbd05-89cf-4e0f-aa59-b8eb58aeae61 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.816883 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-672bee14-1bb9-4e32-9f03-c1abc08aab63 req-88acbd05-89cf-4e0f-aa59-b8eb58aeae61 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.842118 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-672bee14-1bb9-4e32-9f03-c1abc08aab63 req-88acbd05-89cf-4e0f-aa59-b8eb58aeae61 service nova] Creating event network-vif-deleted:ee6f0ba7-a6c4-4928-83c7-3ca4695adb95 for instance c7a959ac-96d1-4ea8-b00c-f60199738daf on hv-cinder-84713 Jun 24 08:52:04.847849 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-672bee14-1bb9-4e32-9f03-c1abc08aab63 req-88acbd05-89cf-4e0f-aa59-b8eb58aeae61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134248 Jun 24 08:52:04.849075 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 549/1094] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:04.909526 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:52:04.910050 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:52:04.910744 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:52:04.911350 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:52:04.911754 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:52:04.920619 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.921085 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.922143 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.922580 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.940801 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Getting quotas for project 33c8998057e6449e9c881b1b279faadd. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:52:04.947019 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Getting quotas for user 038c41319feb49a486832af853c332b1 and project 33c8998057e6449e9c881b1b279faadd. Resources: {'cores', 'ram', 'instances'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:52:05.022135 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:52:05.024342 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c80dd734-6517-4658-948c-3c46e44030c5',volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:52:05.161599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [5ba9dbce-2ca1-409d-810d-c67e17844ec2] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 08:52:05.353101 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:05.353838 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:05.368581 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:05.369402 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:05.370497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:05.371189 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:05.387244 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf HTTP/1.1 Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:52:05.389273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:05.390919 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'c7a959ac-96d1-4ea8-b00c-f60199738daf'} Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:05.391952 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:05.393508 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:05.395307 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:05.395307 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-651663ca-1058-4b31-a4b0-2677126d62ae tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 404 len: 111 microversion: 2.1 time: 0.043149 Jun 24 08:52:05.396640 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 550/1095] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:05 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:05.402460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-83667979-3566-43c1-a747-a9988fae7aa6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '.version_select at 0x7f0a6ff1d310>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:05.421682 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-83667979-3566-43c1-a747-a9988fae7aa6 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020598248" status: 202 len: 0 microversion: 2.1 time: 0.023762 Jun 24 08:52:05.422296 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 551/1096] 10.222.0.13 () {58 vars in 1220 bytes} [Fri Jun 24 08:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020598248 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:52:06.169972 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [5ba9dbce-2ca1-409d-810d-c67e17844ec2] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46032. Jun 24 08:52:06.174003 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d1302bfd-6fc0-40a1-8a0f-a4abd4f885d6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.106464 Jun 24 08:52:06.174644 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 546/1097] 10.222.0.13 () {60 vars in 1146 bytes} [Fri Jun 24 08:52:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:52:06.184419 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-109c5cad-f473-4c3f-a452-742fcbaa3dc0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:06.185032 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-109c5cad-f473-4c3f-a452-742fcbaa3dc0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:06.240314 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-109c5cad-f473-4c3f-a452-742fcbaa3dc0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:06.248402 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-109c5cad-f473-4c3f-a452-742fcbaa3dc0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1089 microversion: 2.1 time: 0.067796 Jun 24 08:52:06.248934 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 552/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:06 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:07.200431 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:07.201060 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:07.207307 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:07.207776 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:07.208516 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:07.208948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:07.223566 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf HTTP/1.1 Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:52:07.225263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.227172 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': 'c7a959ac-96d1-4ea8-b00c-f60199738daf'} Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:07.227937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.229195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.230512 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:07.230512 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cae4b518-091a-4739-8053-66729459ae46 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 404 len: 111 microversion: 2.1 time: 0.032093 Jun 24 08:52:07.230512 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 547/1099] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:52:07 2022] DELETE /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:07.238172 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:07.239239 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: c7a959ac-96d1-4ea8-b00c-f60199738daf] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:07.246501 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:07.246957 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:07.247742 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:07.248197 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:07.262696 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf HTTP/1.1 Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:52:07.264373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.265824 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'c7a959ac-96d1-4ea8-b00c-f60199738daf'} Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:07.267449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. Jun 24 08:52:07.269084 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:07.270460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance c7a959ac-96d1-4ea8-b00c-f60199738daf could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:07.270460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f0699e59-6cd8-40f9-9e3b-15970a87ffa5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf" status: 404 len: 111 microversion: 2.1 time: 0.032671 Jun 24 08:52:07.270460 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 553/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:07 2022] GET /compute/v2.1/servers/c7a959ac-96d1-4ea8-b00c-f60199738daf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:07.270687 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b31cad96-7f12-4307-90fc-57401fd6434a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:07.270687 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b31cad96-7f12-4307-90fc-57401fd6434a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:07.330878 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b31cad96-7f12-4307-90fc-57401fd6434a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:07.338906 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b31cad96-7f12-4307-90fc-57401fd6434a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1089 microversion: 2.1 time: 0.076181 Jun 24 08:52:07.339490 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 548/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:07 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:08.363659 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-35255a14-d4f6-486e-8968-ab1ad522c104 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:08.364322 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-35255a14-d4f6-486e-8968-ab1ad522c104 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:08.436229 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:08.436750 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:08.440962 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-35255a14-d4f6-486e-8968-ab1ad522c104 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:08.448946 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-35255a14-d4f6-486e-8968-ab1ad522c104 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1089 microversion: 2.1 time: 0.089422 Jun 24 08:52:08.449876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 554/1102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:08 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1089 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:08.452956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.453399 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.454285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.454821 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.470000 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd HTTP/1.1 Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:52:08.471639 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.473273 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '99c8e6a0-6446-4747-964e-09d614c2eabd'} Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:08.474374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.475830 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.478389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:08.478389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eed1b521-c77c-4d70-ba2e-b576eb2caad8 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 404 len: 111 microversion: 2.1 time: 0.041012 Jun 24 08:52:08.478389 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 549/1103] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:52:08 2022] DELETE /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:08.482129 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:08.482749 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 99c8e6a0-6446-4747-964e-09d614c2eabd] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:08.489419 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.489901 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.490663 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.491100 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.504298 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd HTTP/1.1 Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:52:08.506107 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.507641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '99c8e6a0-6446-4747-964e-09d614c2eabd'} Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:08.508873 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. Jun 24 08:52:08.510110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.511207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance 99c8e6a0-6446-4747-964e-09d614c2eabd could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:08.511207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-13563437-aeed-4863-8274-07f27f0c7a9e tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd" status: 404 len: 111 microversion: 2.1 time: 0.029187 Jun 24 08:52:08.511207 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 555/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:08 2022] GET /compute/v2.1/servers/99c8e6a0-6446-4747-964e-09d614c2eabd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:08.517200 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:08.517758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:08.525263 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.525765 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.526489 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.526915 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.541070 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc HTTP/1.1 Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:52:08.542629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.544308 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': 'f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc'} Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:08.545252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.546759 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.548213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:08.548213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e8e61935-b928-4eb9-b8b0-53f41f11f5e5 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 404 len: 111 microversion: 2.1 time: 0.030615 Jun 24 08:52:08.548213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 550/1105] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:52:08 2022] DELETE /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:08.553985 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:08.554776 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:08.560856 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.561230 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.562026 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.562468 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.576627 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc HTTP/1.1 Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:52:08.578553 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.580157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': 'f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc'} Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:08.581147 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. Jun 24 08:52:08.582418 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:08.583738 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:08.583738 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-58ae5c9b-4356-4eda-a3af-25faef56b43f tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc" status: 404 len: 111 microversion: 2.1 time: 0.030539 Jun 24 08:52:08.583738 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 556/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:08 2022] GET /compute/v2.1/servers/f8e7802a-d7a1-432a-a3a3-7a2ec3d89afc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:09.466931 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-885f5847-ddea-40ef-ab34-9e6e0826ab70 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:09.467675 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-885f5847-ddea-40ef-ab34-9e6e0826ab70 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:09.520832 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-885f5847-ddea-40ef-ab34-9e6e0826ab70 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:09.528326 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-885f5847-ddea-40ef-ab34-9e6e0826ab70 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1089 microversion: 2.1 time: 0.065751 Jun 24 08:52:09.528890 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 551/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:09 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:09.730629 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:09.731282 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:09.738184 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:09.738641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:09.739421 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:09.739861 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:09.754336 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 HTTP/1.1 Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Host: 10.222.0.13 Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:52:09.756259 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: exception: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.758540 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: action_args: {'id': '57397a13-99c7-451e-8c0a-a7c6303a7fa9'} Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:09.760033 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.761513 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.763405 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:09.763405 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ea4b5fee-b712-4a70-aac6-6a8ad98d0cef tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "DELETE /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 404 len: 111 microversion: 2.1 time: 0.031833 Jun 24 08:52:09.763405 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 557/1108] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:52:09 2022] DELETE /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:09.768732 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:09.769335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] [instance: 57397a13-99c7-451e-8c0a-a7c6303a7fa9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:09.777252 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:09.777710 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:09.778512 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:09.778939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:09.792285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] HTTP exception thrown: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Request method failure captured: Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 HTTP/1.1 Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXoSqmZB1ehIER3Kss-gcaGaoWgcEzI7jk4HhD275M7BX0toXB7mWL2fJnVUxwVW7EdD4T5slWn7Me-f3H9uDHHGy4W_8g_ATM62bnbN0aj_YPdk-g-62fueQoDAZ7valb8R1nvrZelwpKgBv_70gP1yCoKxV3mhNLHdRGuyFo7d4AE Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:52:09.793862 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7787ee132e9e4e23b1407718fb366406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7787ee132e9e4e23b1407718fb366406", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 7787ee132e9e4e23b1407718fb366406 Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-708335206 Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 8d15a76041274e7381087bd21eb674c9 Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-708335206-project Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.795465 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '57397a13-99c7-451e-8c0a-a7c6303a7fa9'} Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:52:09.796370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. Jun 24 08:52:09.797861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:52:09.799285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] Returning 404 to user: Instance 57397a13-99c7-451e-8c0a-a7c6303a7fa9 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:52:09.799285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e9ea0222-cbf2-41d7-8d47-3de66ceac2c7 tempest-AttachVolumeNegativeTest-708335206 tempest-AttachVolumeNegativeTest-708335206-project] 10.222.0.13 "GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9" status: 404 len: 111 microversion: 2.1 time: 0.030306 Jun 24 08:52:09.799285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 552/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:09 2022] GET /compute/v2.1/servers/57397a13-99c7-451e-8c0a-a7c6303a7fa9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:52:10.544481 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-01f9438b-d839-443b-8b05-76ae68aa932a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:10.545003 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-01f9438b-d839-443b-8b05-76ae68aa932a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:10.550967 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01f9438b-d839-443b-8b05-76ae68aa932a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:10.551406 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01f9438b-d839-443b-8b05-76ae68aa932a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:10.552198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01f9438b-d839-443b-8b05-76ae68aa932a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:10.552590 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01f9438b-d839-443b-8b05-76ae68aa932a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:10.615324 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-01f9438b-d839-443b-8b05-76ae68aa932a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:10.623528 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-01f9438b-d839-443b-8b05-76ae68aa932a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1139 microversion: 2.1 time: 0.082979 Jun 24 08:52:10.624315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 558/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:10 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:11.641608 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0494d450-98aa-4423-b627-4974652a4eeb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:11.643043 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0494d450-98aa-4423-b627-4974652a4eeb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:11.651145 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0494d450-98aa-4423-b627-4974652a4eeb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:11.665152 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0494d450-98aa-4423-b627-4974652a4eeb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:11.666161 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0494d450-98aa-4423-b627-4974652a4eeb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:11.670238 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0494d450-98aa-4423-b627-4974652a4eeb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:11.880381 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0494d450-98aa-4423-b627-4974652a4eeb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:11.893861 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0494d450-98aa-4423-b627-4974652a4eeb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1205 microversion: 2.1 time: 0.256578 Jun 24 08:52:11.913937 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 553/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:11 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1205 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:12.937454 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-149a5e65-493d-49aa-b5a8-d5dc6d3cdbce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:12.938273 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-149a5e65-493d-49aa-b5a8-d5dc6d3cdbce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:12.951373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-149a5e65-493d-49aa-b5a8-d5dc6d3cdbce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:12.952258 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-149a5e65-493d-49aa-b5a8-d5dc6d3cdbce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:12.953383 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-149a5e65-493d-49aa-b5a8-d5dc6d3cdbce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:12.954078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-149a5e65-493d-49aa-b5a8-d5dc6d3cdbce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:13.303114 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-149a5e65-493d-49aa-b5a8-d5dc6d3cdbce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:13.319191 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-149a5e65-493d-49aa-b5a8-d5dc6d3cdbce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.386021 Jun 24 08:52:13.320462 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 559/1112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:12 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:13.661245 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-cb6f866b-881f-4c9e-866a-2c0482c584d7 req-b974a195-5229-43f2-ada9-8e9d58719dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59293513-ff81-4ff4-8828-f2f9018c0996", "tag": "3ea8002d-1049-4dbe-9f47-b18b6cf8baf1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:13.671464 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-cb6f866b-881f-4c9e-866a-2c0482c584d7 req-b974a195-5229-43f2-ada9-8e9d58719dfb service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:13.671907 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-cb6f866b-881f-4c9e-866a-2c0482c584d7 req-b974a195-5229-43f2-ada9-8e9d58719dfb service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:13.692022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-cb6f866b-881f-4c9e-866a-2c0482c584d7 req-b974a195-5229-43f2-ada9-8e9d58719dfb service nova] Creating event network-changed:3ea8002d-1049-4dbe-9f47-b18b6cf8baf1 for instance 59293513-ff81-4ff4-8828-f2f9018c0996 on hv-cinder-84713 Jun 24 08:52:13.697926 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-cb6f866b-881f-4c9e-866a-2c0482c584d7 req-b974a195-5229-43f2-ada9-8e9d58719dfb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042421 Jun 24 08:52:13.698732 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 554/1113] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:14.338250 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6ed75857-5b11-49e3-9504-4c1876b34461 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:14.339315 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6ed75857-5b11-49e3-9504-4c1876b34461 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:14.348166 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6ed75857-5b11-49e3-9504-4c1876b34461 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:14.348711 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6ed75857-5b11-49e3-9504-4c1876b34461 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:14.349632 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6ed75857-5b11-49e3-9504-4c1876b34461 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:14.350386 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6ed75857-5b11-49e3-9504-4c1876b34461 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:14.825245 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6ed75857-5b11-49e3-9504-4c1876b34461 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:14.838157 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6ed75857-5b11-49e3-9504-4c1876b34461 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.505516 Jun 24 08:52:14.839232 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 560/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:14 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:15.854028 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:15.858938 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-74c14733-30fe-4a4a-ab90-fc73f1abf326 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:15.859656 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-74c14733-30fe-4a4a-ab90-fc73f1abf326 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:15.866357 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74c14733-30fe-4a4a-ab90-fc73f1abf326 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:15.867335 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74c14733-30fe-4a4a-ab90-fc73f1abf326 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:15.868135 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74c14733-30fe-4a4a-ab90-fc73f1abf326 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:15.868611 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74c14733-30fe-4a4a-ab90-fc73f1abf326 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:16.012398 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-74c14733-30fe-4a4a-ab90-fc73f1abf326 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:16.020463 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-74c14733-30fe-4a4a-ab90-fc73f1abf326 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.167865 Jun 24 08:52:16.021033 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 555/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:15 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:17.041153 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5a64e738-d7b0-4d59-b4ca-71c307757425 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:17.042355 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5a64e738-d7b0-4d59-b4ca-71c307757425 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:17.049416 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5a64e738-d7b0-4d59-b4ca-71c307757425 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:17.049988 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5a64e738-d7b0-4d59-b4ca-71c307757425 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:17.050826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5a64e738-d7b0-4d59-b4ca-71c307757425 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:17.051266 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5a64e738-d7b0-4d59-b4ca-71c307757425 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:17.197152 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5a64e738-d7b0-4d59-b4ca-71c307757425 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:17.204580 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5a64e738-d7b0-4d59-b4ca-71c307757425 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.169965 Jun 24 08:52:17.205154 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 561/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:17 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:18.220942 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-877a5fb9-6d1e-4aa7-bd5d-33f0635b5d6e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:18.221723 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-877a5fb9-6d1e-4aa7-bd5d-33f0635b5d6e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:18.224084 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:18.231046 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-877a5fb9-6d1e-4aa7-bd5d-33f0635b5d6e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:18.231480 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-877a5fb9-6d1e-4aa7-bd5d-33f0635b5d6e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:18.232251 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-877a5fb9-6d1e-4aa7-bd5d-33f0635b5d6e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:18.232690 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-877a5fb9-6d1e-4aa7-bd5d-33f0635b5d6e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:18.236219 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:18.382426 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-877a5fb9-6d1e-4aa7-bd5d-33f0635b5d6e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:18.398738 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-877a5fb9-6d1e-4aa7-bd5d-33f0635b5d6e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.181461 Jun 24 08:52:18.399330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 556/1117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:18 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:19.415689 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bab1f7ca-60cd-4c7a-9de1-afc401b7a3f0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:19.416414 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bab1f7ca-60cd-4c7a-9de1-afc401b7a3f0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:19.418828 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:19.424709 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bab1f7ca-60cd-4c7a-9de1-afc401b7a3f0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:19.425155 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bab1f7ca-60cd-4c7a-9de1-afc401b7a3f0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:19.425948 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bab1f7ca-60cd-4c7a-9de1-afc401b7a3f0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:19.426386 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bab1f7ca-60cd-4c7a-9de1-afc401b7a3f0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:19.567830 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bab1f7ca-60cd-4c7a-9de1-afc401b7a3f0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:19.576298 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bab1f7ca-60cd-4c7a-9de1-afc401b7a3f0 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.164470 Jun 24 08:52:19.576966 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 562/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:19 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:20.595502 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d1740dba-3d15-42b3-b778-b382cb59fa88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:20.596256 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d1740dba-3d15-42b3-b778-b382cb59fa88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:20.598704 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=10 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:20.604877 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1740dba-3d15-42b3-b778-b382cb59fa88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:20.605321 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1740dba-3d15-42b3-b778-b382cb59fa88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:20.606140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1740dba-3d15-42b3-b778-b382cb59fa88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:20.606573 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1740dba-3d15-42b3-b778-b382cb59fa88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:20.755380 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d1740dba-3d15-42b3-b778-b382cb59fa88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:20.763782 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d1740dba-3d15-42b3-b778-b382cb59fa88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.172993 Jun 24 08:52:20.764293 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 557/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:20 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:21.780848 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f110efdb-eabd-4927-af89-1ddc0c101ba8 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:21.782238 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f110efdb-eabd-4927-af89-1ddc0c101ba8 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:21.784934 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:21.791334 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f110efdb-eabd-4927-af89-1ddc0c101ba8 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:21.792007 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f110efdb-eabd-4927-af89-1ddc0c101ba8 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:21.793876 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f110efdb-eabd-4927-af89-1ddc0c101ba8 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:21.794596 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f110efdb-eabd-4927-af89-1ddc0c101ba8 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:21.798890 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:21.954692 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f110efdb-eabd-4927-af89-1ddc0c101ba8 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:21.964437 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f110efdb-eabd-4927-af89-1ddc0c101ba8 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.187705 Jun 24 08:52:21.965093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 563/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:21 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:22.987274 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bf2d4338-8f1c-4215-982c-56e22a675b72 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:22.987948 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bf2d4338-8f1c-4215-982c-56e22a675b72 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:22.995574 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf2d4338-8f1c-4215-982c-56e22a675b72 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:22.996012 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf2d4338-8f1c-4215-982c-56e22a675b72 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:22.996773 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf2d4338-8f1c-4215-982c-56e22a675b72 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:22.997207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf2d4338-8f1c-4215-982c-56e22a675b72 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:23.149794 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bf2d4338-8f1c-4215-982c-56e22a675b72 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:23.157899 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bf2d4338-8f1c-4215-982c-56e22a675b72 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.175206 Jun 24 08:52:23.158494 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 558/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:22 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:24.064076 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-f5570162-897e-4a3d-b967-e34febd63229 req-55f20be2-25f5-4ad4-9042-61b11cc4e252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59293513-ff81-4ff4-8828-f2f9018c0996", "name": "network-vif-plugged", "status": "completed", "tag": "3ea8002d-1049-4dbe-9f47-b18b6cf8baf1"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:24.073003 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f5570162-897e-4a3d-b967-e34febd63229 req-55f20be2-25f5-4ad4-9042-61b11cc4e252 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.073457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f5570162-897e-4a3d-b967-e34febd63229 req-55f20be2-25f5-4ad4-9042-61b11cc4e252 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.086555 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-f5570162-897e-4a3d-b967-e34febd63229 req-55f20be2-25f5-4ad4-9042-61b11cc4e252 service nova] Creating event network-vif-plugged:3ea8002d-1049-4dbe-9f47-b18b6cf8baf1 for instance 59293513-ff81-4ff4-8828-f2f9018c0996 on hv-cinder-84713 Jun 24 08:52:24.091821 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-f5570162-897e-4a3d-b967-e34febd63229 req-55f20be2-25f5-4ad4-9042-61b11cc4e252 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172995 Jun 24 08:52:24.092408 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 564/1122] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:52:24.175486 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0481dc00-e6a4-452c-824e-21e0b4f92089 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:24.176075 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0481dc00-e6a4-452c-824e-21e0b4f92089 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:24.182696 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0481dc00-e6a4-452c-824e-21e0b4f92089 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.183130 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0481dc00-e6a4-452c-824e-21e0b4f92089 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.183901 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0481dc00-e6a4-452c-824e-21e0b4f92089 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.184939 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0481dc00-e6a4-452c-824e-21e0b4f92089 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.390673 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0481dc00-e6a4-452c-824e-21e0b4f92089 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:24.402506 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0481dc00-e6a4-452c-824e-21e0b4f92089 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1261 microversion: 2.1 time: 0.230801 Jun 24 08:52:24.403510 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 559/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:24 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:25.420204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b1f90909-5eb0-4fc2-b580-99ae4329ab24 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:25.420908 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b1f90909-5eb0-4fc2-b580-99ae4329ab24 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:25.431588 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1f90909-5eb0-4fc2-b580-99ae4329ab24 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:25.432042 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1f90909-5eb0-4fc2-b580-99ae4329ab24 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:25.432826 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1f90909-5eb0-4fc2-b580-99ae4329ab24 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:25.433272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1f90909-5eb0-4fc2-b580-99ae4329ab24 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:25.579678 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b1f90909-5eb0-4fc2-b580-99ae4329ab24 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:25.589457 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b1f90909-5eb0-4fc2-b580-99ae4329ab24 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1445 microversion: 2.1 time: 0.173404 Jun 24 08:52:25.590437 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 565/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:25 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:25.606393 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6b514d27-a81c-4510-b3b6-86857a14a307 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:25.606978 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6b514d27-a81c-4510-b3b6-86857a14a307 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:25.613889 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b514d27-a81c-4510-b3b6-86857a14a307 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:25.614330 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b514d27-a81c-4510-b3b6-86857a14a307 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:25.615095 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b514d27-a81c-4510-b3b6-86857a14a307 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:25.615525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b514d27-a81c-4510-b3b6-86857a14a307 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:25.758577 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6b514d27-a81c-4510-b3b6-86857a14a307 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:25.768960 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6b514d27-a81c-4510-b3b6-86857a14a307 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1445 microversion: 2.1 time: 0.166245 Jun 24 08:52:25.769684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 560/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:25 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1445 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:27.755970 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-0c47c056-9644-400b-8fc5-70aac3b3496c req-31a05850-9717-46a9-a0d4-cdff699bc786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59293513-ff81-4ff4-8828-f2f9018c0996", "tag": "3ea8002d-1049-4dbe-9f47-b18b6cf8baf1"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:27.766227 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0c47c056-9644-400b-8fc5-70aac3b3496c req-31a05850-9717-46a9-a0d4-cdff699bc786 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:27.766675 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0c47c056-9644-400b-8fc5-70aac3b3496c req-31a05850-9717-46a9-a0d4-cdff699bc786 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:27.778965 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-0c47c056-9644-400b-8fc5-70aac3b3496c req-31a05850-9717-46a9-a0d4-cdff699bc786 service nova] Creating event network-changed:3ea8002d-1049-4dbe-9f47-b18b6cf8baf1 for instance 59293513-ff81-4ff4-8828-f2f9018c0996 on hv-cinder-84713 Jun 24 08:52:27.785133 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-0c47c056-9644-400b-8fc5-70aac3b3496c req-31a05850-9717-46a9-a0d4-cdff699bc786 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033025 Jun 24 08:52:27.786449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 566/1126] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:15.838892 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:54:15.839657 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Fri Jun 24 08:54:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:54:32.835800 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=9 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:32.836543 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=29 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:32.840578 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ca89c3b-dbe5-46fd-84a5-8ab8508fd444 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:54:32.841110 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1ca89c3b-dbe5-46fd-84a5-8ab8508fd444 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:32.848720 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ca89c3b-dbe5-46fd-84a5-8ab8508fd444 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:32.849169 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ca89c3b-dbe5-46fd-84a5-8ab8508fd444 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.850046 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ca89c3b-dbe5-46fd-84a5-8ab8508fd444 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:32.850486 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ca89c3b-dbe5-46fd-84a5-8ab8508fd444 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.873317 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-1ca89c3b-dbe5-46fd-84a5-8ab8508fd444 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lazy-loading 'flavor' on Instance uuid 59293513-ff81-4ff4-8828-f2f9018c0996 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:54:32.982848 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1ca89c3b-dbe5-46fd-84a5-8ab8508fd444 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "POST /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996/action" status: 202 len: 0 microversion: 2.1 time: 0.148597 Jun 24 08:54:32.983442 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 561/1127] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:54:32 2022] POST /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:54:32.990102 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a6057a9-e58a-43ab-96e7-78e0fcd3a271] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 08:54:32.990721 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=7 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:32.991485 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=15 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:32.995978 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-92f85e72-5138-4885-90a3-1dfbe89c6959 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:32.996679 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-92f85e72-5138-4885-90a3-1dfbe89c6959 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:33.004823 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92f85e72-5138-4885-90a3-1dfbe89c6959 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.005312 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92f85e72-5138-4885-90a3-1dfbe89c6959 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.006056 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92f85e72-5138-4885-90a3-1dfbe89c6959 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.006491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-92f85e72-5138-4885-90a3-1dfbe89c6959 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.145247 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-92f85e72-5138-4885-90a3-1dfbe89c6959 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:33.152844 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-92f85e72-5138-4885-90a3-1dfbe89c6959 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.164651 Jun 24 08:54:33.153394 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 567/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:32 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:34.172895 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-903fc13a-33aa-4caa-b0b0-a0db37f16aff tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:34.173611 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-903fc13a-33aa-4caa-b0b0-a0db37f16aff tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:34.179819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-903fc13a-33aa-4caa-b0b0-a0db37f16aff tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.180300 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-903fc13a-33aa-4caa-b0b0-a0db37f16aff tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.181014 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-903fc13a-33aa-4caa-b0b0-a0db37f16aff tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.181448 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-903fc13a-33aa-4caa-b0b0-a0db37f16aff tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.320260 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-903fc13a-33aa-4caa-b0b0-a0db37f16aff tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:34.327781 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-903fc13a-33aa-4caa-b0b0-a0db37f16aff tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.160058 Jun 24 08:54:34.328343 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 562/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:34 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:35.345568 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1c04e15c-bad0-437e-a060-da5e00c6d248 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:35.346211 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1c04e15c-bad0-437e-a060-da5e00c6d248 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:35.354786 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c04e15c-bad0-437e-a060-da5e00c6d248 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:35.355301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c04e15c-bad0-437e-a060-da5e00c6d248 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.356113 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c04e15c-bad0-437e-a060-da5e00c6d248 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:35.356559 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c04e15c-bad0-437e-a060-da5e00c6d248 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.365136 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a6057a9-e58a-43ab-96e7-78e0fcd3a271] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46896. Jun 24 08:54:35.495552 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1c04e15c-bad0-437e-a060-da5e00c6d248 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:35.503524 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1c04e15c-bad0-437e-a060-da5e00c6d248 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.162309 Jun 24 08:54:35.504093 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 568/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:35 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:36.521082 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-64355229-32fe-46d3-ba1a-fbfa5184e0bf tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:36.521679 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-64355229-32fe-46d3-ba1a-fbfa5184e0bf tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:36.529196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64355229-32fe-46d3-ba1a-fbfa5184e0bf tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.529726 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64355229-32fe-46d3-ba1a-fbfa5184e0bf tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.530802 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64355229-32fe-46d3-ba1a-fbfa5184e0bf tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.531247 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64355229-32fe-46d3-ba1a-fbfa5184e0bf tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.668147 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64355229-32fe-46d3-ba1a-fbfa5184e0bf tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:36.676374 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-64355229-32fe-46d3-ba1a-fbfa5184e0bf tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.159167 Jun 24 08:54:36.676952 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 563/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:36 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:37.694587 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-551adcb5-6e51-4daa-8eb7-a2f61e580e87 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:37.695201 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-551adcb5-6e51-4daa-8eb7-a2f61e580e87 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:37.701221 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-551adcb5-6e51-4daa-8eb7-a2f61e580e87 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.701661 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-551adcb5-6e51-4daa-8eb7-a2f61e580e87 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.702493 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-551adcb5-6e51-4daa-8eb7-a2f61e580e87 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.702929 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-551adcb5-6e51-4daa-8eb7-a2f61e580e87 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.840636 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-551adcb5-6e51-4daa-8eb7-a2f61e580e87 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:37.849005 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-551adcb5-6e51-4daa-8eb7-a2f61e580e87 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.158707 Jun 24 08:54:37.849505 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 569/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:37 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:38.866646 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0751e20d-5edb-49eb-a17e-d46ea170685d tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:38.867256 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0751e20d-5edb-49eb-a17e-d46ea170685d tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:38.874053 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0751e20d-5edb-49eb-a17e-d46ea170685d tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.874496 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0751e20d-5edb-49eb-a17e-d46ea170685d tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:38.876372 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0751e20d-5edb-49eb-a17e-d46ea170685d tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.876819 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0751e20d-5edb-49eb-a17e-d46ea170685d tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:39.012238 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0751e20d-5edb-49eb-a17e-d46ea170685d tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:39.020061 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0751e20d-5edb-49eb-a17e-d46ea170685d tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.157367 Jun 24 08:54:39.020629 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 564/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:38 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:40.037436 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-13f51dc1-65af-47ad-b7b4-801c59b95476 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:40.038089 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-13f51dc1-65af-47ad-b7b4-801c59b95476 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:40.044536 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13f51dc1-65af-47ad-b7b4-801c59b95476 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.044977 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13f51dc1-65af-47ad-b7b4-801c59b95476 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.045766 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13f51dc1-65af-47ad-b7b4-801c59b95476 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.046198 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13f51dc1-65af-47ad-b7b4-801c59b95476 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.187516 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-13f51dc1-65af-47ad-b7b4-801c59b95476 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:40.195794 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-13f51dc1-65af-47ad-b7b4-801c59b95476 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.162246 Jun 24 08:54:40.196352 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 570/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:40 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:41.213426 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-baca71db-6b91-463c-a180-050bf72bdd25 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:41.214102 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-baca71db-6b91-463c-a180-050bf72bdd25 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:41.220935 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-baca71db-6b91-463c-a180-050bf72bdd25 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.221371 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-baca71db-6b91-463c-a180-050bf72bdd25 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.222168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-baca71db-6b91-463c-a180-050bf72bdd25 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.222595 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-baca71db-6b91-463c-a180-050bf72bdd25 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.355542 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-baca71db-6b91-463c-a180-050bf72bdd25 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:41.364762 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-baca71db-6b91-463c-a180-050bf72bdd25 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.155102 Jun 24 08:54:41.365337 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 565/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:41 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:42.383641 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8346c6a0-ecd3-43e8-9860-4e4dfff8126c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:42.384251 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8346c6a0-ecd3-43e8-9860-4e4dfff8126c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:42.391607 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8346c6a0-ecd3-43e8-9860-4e4dfff8126c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.392345 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8346c6a0-ecd3-43e8-9860-4e4dfff8126c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.392743 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8346c6a0-ecd3-43e8-9860-4e4dfff8126c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.393185 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8346c6a0-ecd3-43e8-9860-4e4dfff8126c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.863597 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8346c6a0-ecd3-43e8-9860-4e4dfff8126c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:42.871725 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8346c6a0-ecd3-43e8-9860-4e4dfff8126c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.492323 Jun 24 08:54:42.872313 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 571/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:42 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:43.889371 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f038f208-2d6c-4614-9a41-de3837f5fd39 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:43.890207 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f038f208-2d6c-4614-9a41-de3837f5fd39 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:43.897022 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f038f208-2d6c-4614-9a41-de3837f5fd39 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.897476 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f038f208-2d6c-4614-9a41-de3837f5fd39 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:43.898315 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f038f208-2d6c-4614-9a41-de3837f5fd39 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.898756 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f038f208-2d6c-4614-9a41-de3837f5fd39 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:44.052758 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f038f208-2d6c-4614-9a41-de3837f5fd39 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:44.061032 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f038f208-2d6c-4614-9a41-de3837f5fd39 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.175408 Jun 24 08:54:44.061640 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 566/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:43 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:45.079567 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-87879368-81eb-4593-8007-0d671c23e8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:45.080113 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-87879368-81eb-4593-8007-0d671c23e8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:45.086961 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87879368-81eb-4593-8007-0d671c23e8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.087413 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87879368-81eb-4593-8007-0d671c23e8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.088185 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87879368-81eb-4593-8007-0d671c23e8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.088744 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87879368-81eb-4593-8007-0d671c23e8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.224860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-87879368-81eb-4593-8007-0d671c23e8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:45.234810 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-87879368-81eb-4593-8007-0d671c23e8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.159495 Jun 24 08:54:45.235688 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 572/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:45 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:46.251739 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-13034dcc-9115-42d5-a92d-f256f9b420ce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:46.252361 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-13034dcc-9115-42d5-a92d-f256f9b420ce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:46.258734 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13034dcc-9115-42d5-a92d-f256f9b420ce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.259177 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13034dcc-9115-42d5-a92d-f256f9b420ce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.259946 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13034dcc-9115-42d5-a92d-f256f9b420ce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.260382 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13034dcc-9115-42d5-a92d-f256f9b420ce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.410972 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-13034dcc-9115-42d5-a92d-f256f9b420ce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:46.419106 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-13034dcc-9115-42d5-a92d-f256f9b420ce tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1571 microversion: 2.1 time: 0.171354 Jun 24 08:54:46.419717 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 567/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:46 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:46.436100 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6d21ed45-0222-4f7b-804a-732b653fcaad tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:54:46.436695 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6d21ed45-0222-4f7b-804a-732b653fcaad tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:46.443846 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6d21ed45-0222-4f7b-804a-732b653fcaad tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.444292 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6d21ed45-0222-4f7b-804a-732b653fcaad tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.445086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6d21ed45-0222-4f7b-804a-732b653fcaad tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.445523 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6d21ed45-0222-4f7b-804a-732b653fcaad tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.524758 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6d21ed45-0222-4f7b-804a-732b653fcaad tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "POST /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996/action" status: 202 len: 0 microversion: 2.1 time: 0.092555 Jun 24 08:54:46.525741 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 573/1140] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Jun 24 08:54:46 2022] POST /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:54:46.539909 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-49bd686a-7711-4427-95ee-746641560c1a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:46.540554 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-49bd686a-7711-4427-95ee-746641560c1a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:46.547700 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49bd686a-7711-4427-95ee-746641560c1a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.547900 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49bd686a-7711-4427-95ee-746641560c1a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.548649 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49bd686a-7711-4427-95ee-746641560c1a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.549159 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49bd686a-7711-4427-95ee-746641560c1a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.739881 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-49bd686a-7711-4427-95ee-746641560c1a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:46.747285 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-49bd686a-7711-4427-95ee-746641560c1a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1579 microversion: 2.1 time: 0.212707 Jun 24 08:54:46.748196 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 568/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:46 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1579 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:47.767141 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e49d3ec8-221a-4ca1-a5fc-f7dcca33364e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:47.767816 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e49d3ec8-221a-4ca1-a5fc-f7dcca33364e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:47.773921 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e49d3ec8-221a-4ca1-a5fc-f7dcca33364e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.774366 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e49d3ec8-221a-4ca1-a5fc-f7dcca33364e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.775163 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e49d3ec8-221a-4ca1-a5fc-f7dcca33364e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.775596 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e49d3ec8-221a-4ca1-a5fc-f7dcca33364e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.932188 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e49d3ec8-221a-4ca1-a5fc-f7dcca33364e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:47.940891 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e49d3ec8-221a-4ca1-a5fc-f7dcca33364e tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1521 microversion: 2.1 time: 0.179220 Jun 24 08:54:47.941456 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 574/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:47 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:48.578560 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-0ea684e7-556f-4ca9-96eb-e8650540d38f req-72044963-8996-473a-b284-caf7aec62280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59293513-ff81-4ff4-8828-f2f9018c0996", "name": "network-vif-unplugged", "status": "completed", "tag": "3ea8002d-1049-4dbe-9f47-b18b6cf8baf1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:54:48.587099 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-0ea684e7-556f-4ca9-96eb-e8650540d38f req-72044963-8996-473a-b284-caf7aec62280 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.587537 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-0ea684e7-556f-4ca9-96eb-e8650540d38f req-72044963-8996-473a-b284-caf7aec62280 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.600494 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-0ea684e7-556f-4ca9-96eb-e8650540d38f req-72044963-8996-473a-b284-caf7aec62280 service nova] Creating event network-vif-unplugged:3ea8002d-1049-4dbe-9f47-b18b6cf8baf1 for instance 59293513-ff81-4ff4-8828-f2f9018c0996 on hv-cinder-84713 Jun 24 08:54:48.605213 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-0ea684e7-556f-4ca9-96eb-e8650540d38f req-72044963-8996-473a-b284-caf7aec62280 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030743 Jun 24 08:54:48.605858 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 569/1143] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:48.959884 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-32b5e9be-0126-4c75-8b7c-a05e6a2fd7ae tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:48.960497 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-32b5e9be-0126-4c75-8b7c-a05e6a2fd7ae tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:48.966959 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32b5e9be-0126-4c75-8b7c-a05e6a2fd7ae tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.967407 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32b5e9be-0126-4c75-8b7c-a05e6a2fd7ae tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.968180 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32b5e9be-0126-4c75-8b7c-a05e6a2fd7ae tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.968760 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32b5e9be-0126-4c75-8b7c-a05e6a2fd7ae tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.195145 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-32b5e9be-0126-4c75-8b7c-a05e6a2fd7ae tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:49.202778 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-32b5e9be-0126-4c75-8b7c-a05e6a2fd7ae tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.246782 Jun 24 08:54:49.204091 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 575/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:48 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:50.221432 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-02215be5-c3bb-45f8-b836-8ccfa847a1c3 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:50.222181 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-02215be5-c3bb-45f8-b836-8ccfa847a1c3 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:50.228711 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02215be5-c3bb-45f8-b836-8ccfa847a1c3 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.229152 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02215be5-c3bb-45f8-b836-8ccfa847a1c3 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.229940 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02215be5-c3bb-45f8-b836-8ccfa847a1c3 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.230370 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02215be5-c3bb-45f8-b836-8ccfa847a1c3 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.366062 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-02215be5-c3bb-45f8-b836-8ccfa847a1c3 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:50.374034 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-02215be5-c3bb-45f8-b836-8ccfa847a1c3 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.156999 Jun 24 08:54:50.374296 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 570/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:50 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:51.392838 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-19c56719-68eb-472d-8b02-72ba8db53352 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:51.393452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-19c56719-68eb-472d-8b02-72ba8db53352 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:51.399996 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19c56719-68eb-472d-8b02-72ba8db53352 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.400440 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19c56719-68eb-472d-8b02-72ba8db53352 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.401204 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19c56719-68eb-472d-8b02-72ba8db53352 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.401640 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19c56719-68eb-472d-8b02-72ba8db53352 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.538725 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-19c56719-68eb-472d-8b02-72ba8db53352 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:51.546189 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-19c56719-68eb-472d-8b02-72ba8db53352 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.157873 Jun 24 08:54:51.546773 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 576/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:51 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:52.563955 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9cf70763-90b5-425e-a96e-2f4655671e88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:52.564582 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9cf70763-90b5-425e-a96e-2f4655671e88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:52.571157 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cf70763-90b5-425e-a96e-2f4655671e88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:52.571599 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cf70763-90b5-425e-a96e-2f4655671e88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:52.572363 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cf70763-90b5-425e-a96e-2f4655671e88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:52.572797 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9cf70763-90b5-425e-a96e-2f4655671e88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:52.716958 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9cf70763-90b5-425e-a96e-2f4655671e88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:52.725813 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9cf70763-90b5-425e-a96e-2f4655671e88 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.166624 Jun 24 08:54:52.726391 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 571/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:52 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:53.742524 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d5daf76f-8c97-4a91-a08d-66a060289a95 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:53.743168 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d5daf76f-8c97-4a91-a08d-66a060289a95 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:53.750689 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d5daf76f-8c97-4a91-a08d-66a060289a95 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:53.751142 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d5daf76f-8c97-4a91-a08d-66a060289a95 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.751928 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d5daf76f-8c97-4a91-a08d-66a060289a95 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:53.752353 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d5daf76f-8c97-4a91-a08d-66a060289a95 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.889454 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d5daf76f-8c97-4a91-a08d-66a060289a95 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:53.897251 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d5daf76f-8c97-4a91-a08d-66a060289a95 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.158569 Jun 24 08:54:53.897862 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 577/1148] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:53 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:54.919097 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7cd4af3b-6be1-48e1-b15d-56add257f8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:54.919737 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7cd4af3b-6be1-48e1-b15d-56add257f8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:54.927278 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7cd4af3b-6be1-48e1-b15d-56add257f8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.927729 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7cd4af3b-6be1-48e1-b15d-56add257f8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.928797 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7cd4af3b-6be1-48e1-b15d-56add257f8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.929347 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7cd4af3b-6be1-48e1-b15d-56add257f8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.070976 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7cd4af3b-6be1-48e1-b15d-56add257f8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:55.078531 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7cd4af3b-6be1-48e1-b15d-56add257f8fb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.163644 Jun 24 08:54:55.079101 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 572/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:54 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:56.099626 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9dbb357e-0499-445c-8abf-d73aced147c1 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:56.100477 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9dbb357e-0499-445c-8abf-d73aced147c1 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:56.107902 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dbb357e-0499-445c-8abf-d73aced147c1 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.108355 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dbb357e-0499-445c-8abf-d73aced147c1 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.109643 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dbb357e-0499-445c-8abf-d73aced147c1 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.110111 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9dbb357e-0499-445c-8abf-d73aced147c1 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.248309 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9dbb357e-0499-445c-8abf-d73aced147c1 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:56.257449 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9dbb357e-0499-445c-8abf-d73aced147c1 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.163765 Jun 24 08:54:56.258078 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 578/1150] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:56 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:57.274571 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ebdaaac7-438c-4437-99a2-841aa485454a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:57.275174 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ebdaaac7-438c-4437-99a2-841aa485454a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:57.282394 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebdaaac7-438c-4437-99a2-841aa485454a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:57.282835 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebdaaac7-438c-4437-99a2-841aa485454a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:57.283625 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebdaaac7-438c-4437-99a2-841aa485454a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:57.284052 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebdaaac7-438c-4437-99a2-841aa485454a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:57.420043 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ebdaaac7-438c-4437-99a2-841aa485454a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:57.428598 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ebdaaac7-438c-4437-99a2-841aa485454a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.157892 Jun 24 08:54:57.429168 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 573/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:57 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:58.445828 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-213356c9-1d8e-4a8c-b803-415934d648f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:58.446439 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-213356c9-1d8e-4a8c-b803-415934d648f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:58.453446 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-213356c9-1d8e-4a8c-b803-415934d648f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.454486 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-213356c9-1d8e-4a8c-b803-415934d648f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.454756 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-213356c9-1d8e-4a8c-b803-415934d648f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.455186 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-213356c9-1d8e-4a8c-b803-415934d648f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.588950 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-213356c9-1d8e-4a8c-b803-415934d648f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:58.597979 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-213356c9-1d8e-4a8c-b803-415934d648f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.155982 Jun 24 08:54:58.598559 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 579/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:58 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:58.676685 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-b6041749-e542-437a-afca-dd839afb41e6 req-d6d62c9e-912b-43ca-99be-7dc152b89fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59293513-ff81-4ff4-8828-f2f9018c0996", "name": "network-vif-plugged", "status": "completed", "tag": "3ea8002d-1049-4dbe-9f47-b18b6cf8baf1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:54:58.689406 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-b6041749-e542-437a-afca-dd839afb41e6 req-d6d62c9e-912b-43ca-99be-7dc152b89fa0 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.689993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-b6041749-e542-437a-afca-dd839afb41e6 req-d6d62c9e-912b-43ca-99be-7dc152b89fa0 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.704200 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-b6041749-e542-437a-afca-dd839afb41e6 req-d6d62c9e-912b-43ca-99be-7dc152b89fa0 service nova] Creating event network-vif-plugged:3ea8002d-1049-4dbe-9f47-b18b6cf8baf1 for instance 59293513-ff81-4ff4-8828-f2f9018c0996 on hv-cinder-84713 Jun 24 08:54:58.709287 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-b6041749-e542-437a-afca-dd839afb41e6 req-d6d62c9e-912b-43ca-99be-7dc152b89fa0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040889 Jun 24 08:54:58.709981 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 574/1153] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:59.615301 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c5f32be0-eca0-499d-b31e-7799c129df5a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:59.615889 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c5f32be0-eca0-499d-b31e-7799c129df5a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:59.622373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c5f32be0-eca0-499d-b31e-7799c129df5a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.622760 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c5f32be0-eca0-499d-b31e-7799c129df5a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.623510 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c5f32be0-eca0-499d-b31e-7799c129df5a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.623942 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c5f32be0-eca0-499d-b31e-7799c129df5a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.760404 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c5f32be0-eca0-499d-b31e-7799c129df5a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:59.767987 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c5f32be0-eca0-499d-b31e-7799c129df5a tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1577 microversion: 2.1 time: 0.156544 Jun 24 08:54:59.768554 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 580/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:59 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:00.787525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-33854e65-aa1e-44b2-9c46-70fcfe4c8747 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:00.787525 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-33854e65-aa1e-44b2-9c46-70fcfe4c8747 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:00.793922 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33854e65-aa1e-44b2-9c46-70fcfe4c8747 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:00.794368 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33854e65-aa1e-44b2-9c46-70fcfe4c8747 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.795140 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33854e65-aa1e-44b2-9c46-70fcfe4c8747 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:00.795573 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33854e65-aa1e-44b2-9c46-70fcfe4c8747 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.935336 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-33854e65-aa1e-44b2-9c46-70fcfe4c8747 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:00.943641 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-33854e65-aa1e-44b2-9c46-70fcfe4c8747 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1564 microversion: 2.1 time: 0.162859 Jun 24 08:55:00.944215 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 575/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:00 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:14.786414 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=30 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:14.794388 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:14.795489 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:14.800367 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5598b3b-a0b2-4240-a1c5-76e65db0d262 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:14.800807 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:14.802745 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a5598b3b-a0b2-4240-a1c5-76e65db0d262 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:14.816860 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5598b3b-a0b2-4240-a1c5-76e65db0d262 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.817297 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5598b3b-a0b2-4240-a1c5-76e65db0d262 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.818280 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5598b3b-a0b2-4240-a1c5-76e65db0d262 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.818726 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5598b3b-a0b2-4240-a1c5-76e65db0d262 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.846373 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a5598b3b-a0b2-4240-a1c5-76e65db0d262 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:56:14.871756 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-61a30ae2-c64a-4480-91ec-db64eeb886b2 req-7dcf8a72-cd57-4ce1-8651-f7b7f8cc9f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59293513-ff81-4ff4-8828-f2f9018c0996", "tag": "3ea8002d-1049-4dbe-9f47-b18b6cf8baf1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:56:14.880363 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-61a30ae2-c64a-4480-91ec-db64eeb886b2 req-7dcf8a72-cd57-4ce1-8651-f7b7f8cc9f85 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.881282 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-61a30ae2-c64a-4480-91ec-db64eeb886b2 req-7dcf8a72-cd57-4ce1-8651-f7b7f8cc9f85 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.894756 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-61a30ae2-c64a-4480-91ec-db64eeb886b2 req-7dcf8a72-cd57-4ce1-8651-f7b7f8cc9f85 service nova] Creating event network-changed:3ea8002d-1049-4dbe-9f47-b18b6cf8baf1 for instance 59293513-ff81-4ff4-8828-f2f9018c0996 on hv-cinder-84713 Jun 24 08:56:14.900240 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-61a30ae2-c64a-4480-91ec-db64eeb886b2 req-7dcf8a72-cd57-4ce1-8651-f7b7f8cc9f85 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111859 Jun 24 08:56:14.900993 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 576/1156] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:14.934452 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a5598b3b-a0b2-4240-a1c5-76e65db0d262 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "DELETE /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 204 len: 0 microversion: 2.1 time: 0.148957 Jun 24 08:56:14.935725 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 581/1157] 10.222.0.13 () {58 vars in 1238 bytes} [Fri Jun 24 08:56:14 2022] DELETE /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:14.944600 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ab4475a0-df25-415a-a4c5-01484f9f95fd tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:14.946304 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ab4475a0-df25-415a-a4c5-01484f9f95fd tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:14.958027 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ab4475a0-df25-415a-a4c5-01484f9f95fd tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.958632 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ab4475a0-df25-415a-a4c5-01484f9f95fd tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.959610 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ab4475a0-df25-415a-a4c5-01484f9f95fd tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.960080 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ab4475a0-df25-415a-a4c5-01484f9f95fd tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.202491 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ab4475a0-df25-415a-a4c5-01484f9f95fd tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:15.210077 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ab4475a0-df25-415a-a4c5-01484f9f95fd tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.269889 Jun 24 08:56:15.210729 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 577/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:14 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:16.229645 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f51a3278-5ed3-4ee8-af56-27fef9288837 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:16.230391 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f51a3278-5ed3-4ee8-af56-27fef9288837 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:16.238165 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f51a3278-5ed3-4ee8-af56-27fef9288837 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.238640 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f51a3278-5ed3-4ee8-af56-27fef9288837 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.239487 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f51a3278-5ed3-4ee8-af56-27fef9288837 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.239872 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f51a3278-5ed3-4ee8-af56-27fef9288837 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.462753 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f51a3278-5ed3-4ee8-af56-27fef9288837 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:16.471491 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f51a3278-5ed3-4ee8-af56-27fef9288837 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1570 microversion: 2.1 time: 0.246007 Jun 24 08:56:16.472371 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 582/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:16 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1570 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:17.181256 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-4bea5bb3-b38c-4a5c-a464-dc0d5539c888 req-3a1f6d62-fc55-4ebb-9a68-b3cdd784bc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59293513-ff81-4ff4-8828-f2f9018c0996", "name": "network-vif-deleted", "tag": "3ea8002d-1049-4dbe-9f47-b18b6cf8baf1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:56:17.196064 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4bea5bb3-b38c-4a5c-a464-dc0d5539c888 req-3a1f6d62-fc55-4ebb-9a68-b3cdd784bc93 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.196715 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4bea5bb3-b38c-4a5c-a464-dc0d5539c888 req-3a1f6d62-fc55-4ebb-9a68-b3cdd784bc93 service nova] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.212270 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-4bea5bb3-b38c-4a5c-a464-dc0d5539c888 req-3a1f6d62-fc55-4ebb-9a68-b3cdd784bc93 service nova] Creating event network-vif-deleted:3ea8002d-1049-4dbe-9f47-b18b6cf8baf1 for instance 59293513-ff81-4ff4-8828-f2f9018c0996 on hv-cinder-84713 Jun 24 08:56:17.219486 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-4bea5bb3-b38c-4a5c-a464-dc0d5539c888 req-3a1f6d62-fc55-4ebb-9a68-b3cdd784bc93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043948 Jun 24 08:56:17.220495 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 578/1160] 10.222.0.13 () {64 vars in 1317 bytes} [Fri Jun 24 08:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:17.490223 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-68c46ca7-0a3a-47c2-aed3-0818e74b57f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:17.491018 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-68c46ca7-0a3a-47c2-aed3-0818e74b57f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:17.499110 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68c46ca7-0a3a-47c2-aed3-0818e74b57f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.499651 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68c46ca7-0a3a-47c2-aed3-0818e74b57f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.500545 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68c46ca7-0a3a-47c2-aed3-0818e74b57f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.501086 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68c46ca7-0a3a-47c2-aed3-0818e74b57f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.575018 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-68c46ca7-0a3a-47c2-aed3-0818e74b57f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038c41319feb49a486832af853c332b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c8998057e6449e9c881b1b279faadd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:17.584492 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-68c46ca7-0a3a-47c2-aed3-0818e74b57f6 tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 200 len: 1220 microversion: 2.1 time: 0.098731 Jun 24 08:56:17.586648 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 583/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:17 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:18.602569 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:18.603265 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] [instance: 59293513-ff81-4ff4-8828-f2f9018c0996] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:18.611444 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.611894 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.612663 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.613092 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Lock "e9a90baf-9f7e-4d3b-8468-40fa6b0dc594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.632319 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] HTTP exception thrown: Instance 59293513-ff81-4ff4-8828-f2f9018c0996 could not be found. Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Request method failure captured: Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 HTTP/1.1 Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Host: 10.222.0.13 Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXsdZn3Gb6lG981Nd84EW37FQEthQvLrFXIJnK5z4su_zqvlCWx7bVZqxSZEsYotvPxlW6fpomtBSFOwnm2v3bH_lB4rpUb8JQtfa9xtPVuZQOm8JWN816eY_mC31YyaXMXuBmze-KNTQjywrXcERYcWYcN2TM33lcK3NlnVGwK_W3g Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Id: 33c8998057e6449e9c881b1b279faadd Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestShelveInstance-698082308 Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:56:18.633956 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33c8998057e6449e9c881b1b279faadd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/33c8998057e6449e9c881b1b279faadd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/33c8998057e6449e9c881b1b279faadd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_33c8998057e6449e9c881b1b279faadd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestShelveInstance-698082308 Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 33c8998057e6449e9c881b1b279faadd Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestShelveInstance-698082308 Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User: tempest-TestShelveInstance-698082308-project Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Id: 038c41319feb49a486832af853c332b1 Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestShelveInstance-698082308-project Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: exception: Instance 59293513-ff81-4ff4-8828-f2f9018c0996 could not be found. Jun 24 08:56:18.635695 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: action_args: {'id': '59293513-ff81-4ff4-8828-f2f9018c0996'} Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59293513-ff81-4ff4-8828-f2f9018c0996 could not be found. Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:56:18.636659 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59293513-ff81-4ff4-8828-f2f9018c0996 could not be found. Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59293513-ff81-4ff4-8828-f2f9018c0996 could not be found. Jun 24 08:56:18.638254 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:56:18.639488 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Returning 404 to user: Instance 59293513-ff81-4ff4-8828-f2f9018c0996 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:56:18.639488 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-05727af0-117f-4e1c-a0aa-12756883106c tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996" status: 404 len: 111 microversion: 2.1 time: 0.037093 Jun 24 08:56:18.639488 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 579/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:18 2022] GET /compute/v2.1/servers/59293513-ff81-4ff4-8828-f2f9018c0996 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:56:18.797522 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-55a47e3a-c28d-4109-bf8f-fa72ab5346bb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] Calling method '.version_select at 0x7f0a6fdf1c10>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:18.815672 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-55a47e3a-c28d-4109-bf8f-fa72ab5346bb tempest-TestShelveInstance-698082308 tempest-TestShelveInstance-698082308-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1932660844" status: 202 len: 0 microversion: 2.1 time: 0.022584 Jun 24 08:56:18.816257 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 584/1163] 10.222.0.13 () {58 vars in 1253 bytes} [Fri Jun 24 08:56:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1932660844 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:57:04.255236 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:57:04.255893 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Fri Jun 24 08:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:57:35.849354 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:57:35.850047 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Fri Jun 24 08:57:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:57:38.798746 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:57:38.799376 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Fri Jun 24 08:57:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:59:01.891117 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:59:01.891750 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Fri Jun 24 08:59:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:59:29.737272 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:59:29.738165 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Fri Jun 24 08:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:59:32.350684 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:59:32.351294 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Fri Jun 24 08:59:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:00:24.265621 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:24.266409 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Fri Jun 24 09:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:00:55.857838 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:55.858585 dv-cinder-847131-2-iscsi devstack@n-api.service[124379]: Fri Jun 24 09:00:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:00:58.807195 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:58.807844 dv-cinder-847131-2-iscsi devstack@n-api.service[124380]: Fri Jun 24 09:00:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!